Jul 27 17:22:38.951637 ip-10-0-131-200 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 27 17:22:38.951650 ip-10-0-131-200 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 27 17:22:38.951660 ip-10-0-131-200 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 27 17:22:38.952045 ip-10-0-131-200 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 27 17:22:48.064280 ip-10-0-131-200 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 27 17:22:48.064294 ip-10-0-131-200 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ca2d08e5dd314d0aa0619aebbab41717 --
Jul 27 17:24:16.857870 ip-10-0-131-200 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 17:24:17.303144 ip-10-0-131-200 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 17:24:17.303144 ip-10-0-131-200 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 17:24:17.303144 ip-10-0-131-200 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 17:24:17.303144 ip-10-0-131-200 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 17:24:17.303144 ip-10-0-131-200 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 17:24:17.305215 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.305123    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 17:24:17.310286 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310269    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:24:17.310286 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310286    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310289    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310293    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310296    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310299    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310302    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310305    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310308    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310310    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310313    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310316    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310318    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310321    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310323    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310326    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310328    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310331    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310334    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310336    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310339    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:24:17.310350 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310349    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310353    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310357    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310361    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310363    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310366    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310369    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310372    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310375    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310377    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310380    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310382    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310385    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310389    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310391    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310394    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310396    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310399    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310401    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310403    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:24:17.310841 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310406    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310408    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310411    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310413    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310415    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310418    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310420    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310423    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310425    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310427    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310430    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310432    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310434    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310438    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310441    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310444    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310446    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310449    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310452    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:24:17.311517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310455    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310457    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310460    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310462    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310465    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310467    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310470    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310472    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310475    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310477    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310480    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310482    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310485    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310487    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310490    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310492    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310495    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310497    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310501    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:24:17.312153 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310505    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310508    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310513    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310516    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310519    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310522    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310525    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310528    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310532    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310536    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310540    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310543    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310546    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310549    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310552    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310554    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310557    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310559    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310562    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:24:17.312634 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.310565    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312512    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312524    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312528    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312531    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312534    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312537    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312540    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312543    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312546    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312549    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312552    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312557    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312561    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312564    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312567    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312570    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312572    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312575    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312595    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:24:17.313107 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312598    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312601    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312604    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312607    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312612    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312618    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312622    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312625    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312628    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312632    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312634    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312637    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312640    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312643    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312646    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312649    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312652    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312658    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312661    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:24:17.313616 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312664    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312666    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312669    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312672    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312675    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312678    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312681    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312684    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312687    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312690    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312693    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312698    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312701    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312703    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312706    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312709    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312712    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312715    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312717    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312720    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:24:17.314086 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312723    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312725    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312728    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312730    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312735    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312738    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312741    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312743    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312746    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312749    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312751    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312754    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312757    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312760    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312762    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312765    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312770    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312774    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312777    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312780    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:24:17.314574 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312783    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312786    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312788    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312791    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312794    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312797    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312800    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312804    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312810    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312813    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312816    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312819    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312824    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312827    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312830    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312833    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312836    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312838    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312842    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:24:17.315081 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312847    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.312850    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313648    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313659    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313663    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313666    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313671    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313675    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313678    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313681    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313684    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313686    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313689    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313691    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313694    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313697    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313699    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313722    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313725    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:24:17.315540 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313729    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313731    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313735    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313738    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313740    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313743    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313746    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313749    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313752    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313755    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313757    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313760    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313763    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313766    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313769    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313771    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313774    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313777    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313780    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313783    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:24:17.316048 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313785    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313788    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313791    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313793    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313796    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313798    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313801    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313803    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313806    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313808    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313812    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313814    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313817    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313820    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313823    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313825    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313828    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313831    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313833    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313836    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:24:17.316531 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313838    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313840    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313843    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313845    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313848    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313851    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313854    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313856    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313860    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313862    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313865    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313869    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313871    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313874    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313877    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313879    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313882    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313884    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313889    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:24:17.317056 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313892    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313895    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313897    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313900    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313902    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313905    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313908    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313911    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313913    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313916    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313918    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313921    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313923    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313926    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313928    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313931    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313935    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313939    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313942    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:24:17.317521 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313945    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313948    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313952    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.313955    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314024    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314032    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314038    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314044    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314050    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314055    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314062    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314067    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314071    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314074    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314077    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314080    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314083    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314086    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314089    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314092    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314101    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314104    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314109    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314112    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 17:24:17.317987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314115    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314118    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314121    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314125    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314128    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314131    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314134    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314137    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314140    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314143    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314150    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314153    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314158    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314161    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314163    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314166    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314169    2580 flags.go:64] FLAG: --enable-server="true"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314172    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314177    2580 flags.go:64] FLAG: --event-burst="100"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314180    2580 flags.go:64] FLAG: --event-qps="50"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314184    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314187    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314190    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314193    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 17:24:17.318573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314196    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314199    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314202    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314205    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314208    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314212    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314214    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314217    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314220    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314223    2580 flags.go:64] FLAG: --feature-gates=""
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314227    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314230    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314233    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314236    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314239    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314241    2580 flags.go:64] FLAG: --help="false"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314244    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314247    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314251    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314254    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314258    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314261    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314264    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 17:24:17.319157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314267    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314270    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314273    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314276    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314279    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314282    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314284    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314288    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314291    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314294    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314297    2580 flags.go:64] FLAG: --lock-file=""
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314299    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314302    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314305    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314315    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314319    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314321    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314324    2580 flags.go:64] FLAG: --logging-format="text"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314327    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314330    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314333    2580 flags.go:64] FLAG: --manifest-url=""
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314336    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314341    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314344    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314347    2580 flags.go:64] FLAG: --max-pods="110"
Jul 27 17:24:17.319756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314350    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314353    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314357    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314360    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314363    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314366    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314369    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314376    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314379    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314383    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314386    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314389    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314394    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314397    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314400    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314403    2580 flags.go:64] FLAG: --port="10250"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314406    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314409    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d8f21f017f1d681e"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314412    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314415    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314418    2580 flags.go:64] FLAG: --register-node="true"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314421    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314425    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314428    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 27 17:24:17.320372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314431    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314434    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314438    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314441    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314444    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314446    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314450    2580 flags.go:64] FLAG: --runonce="false"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314453    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314456    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314459    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314462    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314466    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314469    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314472    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314475    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314478    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314481    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314484    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314487    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314490    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314493    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314495    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314501    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314504    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314506    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 17:24:17.320978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314510    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314513    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314516    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314518    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314521    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314524    2580 flags.go:64] FLAG: --v="2"
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314528    2580 flags.go:64] FLAG: --version="false"
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314533    2580 flags.go:64] FLAG: --vmodule=""
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314536    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.314540    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314690    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314694    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314697    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314700    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314703    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314706    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314709    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314712    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314717    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314720    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314723    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314725    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:24:17.321623 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314728    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314731    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314733    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314736    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314739    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314742    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314744    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314747    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314749    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314752    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314755    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314757    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314760    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314763    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314765    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314768    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314770    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314773    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314777    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314779    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:24:17.322259 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314782    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314784    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314787    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314791    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314795    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314797    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314802    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314805    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314808    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314811    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314814    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314816    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314819    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314822    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314824    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314827    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314830    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314832    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314835    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:24:17.322839 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314838    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314840    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314843    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314846    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314848    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314851    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314853    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314856    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314858    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314861    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314863    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314866    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314869    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314872    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314874    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314877    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314880    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314882    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314885    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314889    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:24:17.323306 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314892    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314896    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314898    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314901    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314904    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314908    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314911    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314914    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314916    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314919    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314922    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314925    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314927    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314930    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314933    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314935    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314938    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314940    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314943    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:24:17.323823 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314946    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:24:17.324284 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314948    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:24:17.324284 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314952    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:24:17.324284 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314956    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:24:17.324284 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314959    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:24:17.324284 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314961    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:24:17.324284 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314965    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:24:17.324284 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314967    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:24:17.324284 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.314970    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:24:17.324284 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.315737    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 17:24:17.324284 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.323140    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 17:24:17.324284 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.323162    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 17:24:17.324284 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.324045    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 17:24:17.324284 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.324053    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 17:24:17.324284 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324120    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324125    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324129    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324132    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324137    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324141    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324144    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324148    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324150    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324153    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324156    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324158    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324162    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324164    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324167    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324170    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324173    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324176    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324178    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324181    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:24:17.324647 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324183    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324186    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324189    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324192    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324195    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324197    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324200    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324203    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324207    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324211    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324213    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324216    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324219    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324222    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324224    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324227    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324230    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324233    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324235    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324238    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:24:17.325134 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324240    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324243    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324246    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324248    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324251    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324254    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324256    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324259    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324262    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324265    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324269    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324272    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324274    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324277    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324279    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324282    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324284    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324287    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324290    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:24:17.325692 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324293    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324296    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324299    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324303    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324306    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324308    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324311    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324314    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324318    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324321    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324325    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324327    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324330    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324333    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324335    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324338    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324341    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324343    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324346    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:24:17.326165 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324348    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324351    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324354    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324357    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324359    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324361    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324364    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324366    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324369    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324371    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324374    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324377    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324379    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324382    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324385    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324388    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324391    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324394    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324396    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324399    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:24:17.326646 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324401    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:24:17.327127 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.324407    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 17:24:17.327127 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324547    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:24:17.327127 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324552    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:24:17.327127 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324555    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:24:17.327127 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324558    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:24:17.327127 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324561    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:24:17.327127 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324564    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:24:17.327127 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324566    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:24:17.327127 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324569    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:24:17.327127 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324572    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:24:17.327127 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324574    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:24:17.327127 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324590    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:24:17.327127 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324594    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:24:17.327127 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324597    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:24:17.327127 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324599    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324602    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324605    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324608    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324611    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324613    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324616    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324619    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324621    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324624    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324627    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324629    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324632    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324635    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324638    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324641    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324644    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324646    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324649    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:24:17.327517 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324652    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324654    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324657    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324660    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324663    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324665    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324670    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324674    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324677    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324680    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324682    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324685    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324688    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324691    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324693    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324695    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324698    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324701    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324703    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324706    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:24:17.328058 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324709    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324711    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324714    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324716    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324719    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324722    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324724    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324727    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324729    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324733    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324735    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324738    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324740    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324743    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324745    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324748    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324750    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324753    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324756    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324758    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:24:17.328548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324760    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324763    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324767    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324769    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324773    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324776    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324780    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324782    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324785    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324788    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324791    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324793    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324796    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324798    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324801    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324804    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324806    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324808    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324811    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:24:17.329038 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324813    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:24:17.329508 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324816    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:24:17.329508 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324819    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:24:17.329508 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324822    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:24:17.329508 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324824    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:24:17.329508 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324827    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:24:17.329508 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324829    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:24:17.329508 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:17.324832    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:24:17.329508 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.324837    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 17:24:17.329508 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.324967    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 17:24:17.329508 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.327410    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 17:24:17.329508 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.329111    2580 server.go:1019] "Starting client certificate rotation"
Jul 27 17:24:17.329508 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.329215    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 17:24:17.329508 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.329257    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 17:24:17.332130 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.332117    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 17:24:17.333782 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.333761    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 17:24:17.343695 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.343677    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 27 17:24:17.346159 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.346141    2580 log.go:25] "Validated CRI v1 image API"
Jul 27 17:24:17.347013 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.346994    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 17:24:17.351231 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.351213    2580 fs.go:135] Filesystem UUIDs: map[6fd894a3-4c15-4cf8-ada3-b0b2fecda2a3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 967714cb-623a-43dc-b8f8-68ab99a09c5b:/dev/nvme0n1p3]
Jul 27 17:24:17.351289 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.351231    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 17:24:17.358188 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.358075    2580 manager.go:216] Machine: {Timestamp:2026-07-27 17:24:17.356635476 +0000 UTC m=+0.371301916 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3176609 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26de9e90cd112db2a20f18be507f38 SystemUUID:ec26de9e-90cd-112d-b2a2-0f18be507f38 BootID:ca2d08e5-dd31-4d0a-a061-9aebbab41717 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:24:e6:e6:fb:d1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:24:e6:e6:fb:d1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:09:24:5c:63:2c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 17:24:17.358188 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.358181    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 17:24:17.358317 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.358268    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 17:24:17.362113 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.362086    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 17:24:17.362251 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.362116    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-200.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 17:24:17.362414 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.362397    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 17:24:17.362978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.362967    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 17:24:17.363010 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.362979    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 17:24:17.363010 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.362987    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 17:24:17.363010 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.363001    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 17:24:17.364274 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.364263    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 17:24:17.367186 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.367172    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 17:24:17.367306 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.367296    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 17:24:17.367340 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.367327    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 17:24:17.367340 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.367337    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 17:24:17.367402 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.367351    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 17:24:17.367402 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.367360    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 27 17:24:17.367402 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.367369    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 17:24:17.367758 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.367747    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 17:24:17.367795 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.367768    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 17:24:17.370047 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.370031    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 17:24:17.372662 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.372646    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 17:24:17.372740 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.372685    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 17:24:17.374821 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.374807    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 17:24:17.374899 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.374827    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 17:24:17.374899 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.374837    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 17:24:17.374899 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.374847    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 17:24:17.374899 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.374861    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 17:24:17.374899 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.374870    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 17:24:17.374899 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.374882    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 17:24:17.374899 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.374890    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 17:24:17.374899 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.374901    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 17:24:17.375139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.374910    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 17:24:17.375139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.374927    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 17:24:17.375139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.374936    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 17:24:17.376756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.376744    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 17:24:17.376859 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.376759    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 17:24:17.378453 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.378430    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-200.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 17:24:17.378553 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.378451    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 17:24:17.378553 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.378453    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 17:24:17.380080 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.380064    2580 server.go:1268] "Started kubelet"
Jul 27 17:24:17.380187 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.380159    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 17:24:17.380234 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.380179    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 17:24:17.380280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.380232    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 17:24:17.381111 ip-10-0-131-200 systemd[1]: Started Kubernetes Kubelet.
Jul 27 17:24:17.382530 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.382512    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 17:24:17.384955 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.384866    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 17:24:17.386435 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.386416    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 17:24:17.394181 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.394161    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 17:24:17.394272 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.394162    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 17:24:17.394735 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.394371    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found"
Jul 27 17:24:17.395063 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.395045    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 17:24:17.395532 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.395157    2580 factory.go:55] Registering systemd factory
Jul 27 17:24:17.395532 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.395484    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 27 17:24:17.395656 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.395319    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 17:24:17.395656 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.395544    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 17:24:17.395749 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.395704    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 17:24:17.395749 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.395713    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 17:24:17.395848 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.395800    2580 factory.go:153] Registering CRI-O factory
Jul 27 17:24:17.395848 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.395813    2580 factory.go:223] Registration of the crio container factory successfully
Jul 27 17:24:17.395941 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.395862    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 17:24:17.395941 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.395884    2580 factory.go:103] Registering Raw factory
Jul 27 17:24:17.395941 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.395898    2580 manager.go:1196] Started watching for new ooms in manager
Jul 27 17:24:17.396386 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.396364    2580 manager.go:349] Starting recovery of all containers
Jul 27 17:24:17.396470 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.395229    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-200.ec2.internal.18c6356ffbb98fe3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-200.ec2.internal,UID:ip-10-0-131-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-200.ec2.internal,},FirstTimestamp:2026-07-27 17:24:17.379864547 +0000 UTC m=+0.394530981,LastTimestamp:2026-07-27 17:24:17.379864547 +0000 UTC m=+0.394530981,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-200.ec2.internal,}"
Jul 27 17:24:17.409307 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.408977    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xmxsv"
Jul 27 17:24:17.410407 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.410391    2580 manager.go:354] Recovery completed
Jul 27 17:24:17.412884 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.412861    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 17:24:17.412961 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.412881    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 17:24:17.415908 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.415895    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:24:17.416616 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.416601    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xmxsv"
Jul 27 17:24:17.417646 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.417626    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:24:17.417793 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.417667    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:24:17.417793 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.417684    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:24:17.418272 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.418255    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 17:24:17.418272 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.418270    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 17:24:17.418402 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.418296    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 17:24:17.418402 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.418262    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:24:17.418995 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.418978    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:24:17.419065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.419009    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:24:17.419065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.419025    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:24:17.421354 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.421340    2580 policy_none.go:49] "None policy: Start"
Jul 27 17:24:17.421413 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.421359    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 17:24:17.421413 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.421373    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 17:24:17.423541 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.423529    2580 policy_none.go:47] "Start"
Jul 27 17:24:17.478218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.460296    2580 manager.go:337] "Starting Device Plugin manager"
Jul 27 17:24:17.478218 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.460324    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 17:24:17.478218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.460337    2580 server.go:87] "Starting device plugin registration server"
Jul 27 17:24:17.478218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.460678    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 17:24:17.478218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.460698    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 17:24:17.478218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.460837    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 17:24:17.478218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.460929    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 17:24:17.478218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.460942    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 17:24:17.478218 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.461437    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 17:24:17.478218 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.461607    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-200.ec2.internal\" not found"
Jul 27 17:24:17.478218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.468766    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 17:24:17.478218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.469824    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 17:24:17.478218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.469858    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 17:24:17.478218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.469880    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 17:24:17.478218 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.469907    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 17:24:17.478218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.472141    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:24:17.561076 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.561010    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:24:17.562007 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.561987    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:24:17.562091 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.562060    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:24:17.562091 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.562071    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:24:17.562156 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.562093    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.568407 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.568391    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.568466 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.568413    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-200.ec2.internal\": node \"ip-10-0-131-200.ec2.internal\" not found"
Jul 27 17:24:17.570853 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.570831    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal"]
Jul 27 17:24:17.570958 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.570913    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:24:17.571726 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.571711    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:24:17.571808 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.571745    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:24:17.571808 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.571759    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:24:17.574108 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.574090    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:24:17.574283 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.574267    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.574343 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.574310    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:24:17.574787 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.574770    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:24:17.574901 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.574804    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:24:17.574901 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.574810    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:24:17.574901 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.574819    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:24:17.574901 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.574829    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:24:17.575305 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.575293    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:24:17.577559 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.577546    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.577661 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.577567    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:24:17.579036 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.579021    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:24:17.579107 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.579045    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:24:17.579107 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.579054    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:24:17.592047 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.592027    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found"
Jul 27 17:24:17.599158 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.599141    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-200.ec2.internal\" not found" node="ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.603858 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.603845    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-200.ec2.internal\" not found" node="ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.692945 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.692919    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found"
Jul 27 17:24:17.696284 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.696268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1f96f4a07b9f4100ed7f79cf800b040b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal\" (UID: \"1f96f4a07b9f4100ed7f79cf800b040b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.696344 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.696291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f96f4a07b9f4100ed7f79cf800b040b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal\" (UID: \"1f96f4a07b9f4100ed7f79cf800b040b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.696344 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.696314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a61dacdec00e617530332f7c59343be-config\") pod \"kube-apiserver-proxy-ip-10-0-131-200.ec2.internal\" (UID: \"0a61dacdec00e617530332f7c59343be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.793436 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.793395    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found"
Jul 27 17:24:17.796676 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.796659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1f96f4a07b9f4100ed7f79cf800b040b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal\" (UID: \"1f96f4a07b9f4100ed7f79cf800b040b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.796770 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.796690    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f96f4a07b9f4100ed7f79cf800b040b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal\" (UID: \"1f96f4a07b9f4100ed7f79cf800b040b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.796770 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.796715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a61dacdec00e617530332f7c59343be-config\") pod \"kube-apiserver-proxy-ip-10-0-131-200.ec2.internal\" (UID: \"0a61dacdec00e617530332f7c59343be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.796770 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.796753    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a61dacdec00e617530332f7c59343be-config\") pod \"kube-apiserver-proxy-ip-10-0-131-200.ec2.internal\" (UID: \"0a61dacdec00e617530332f7c59343be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.796889 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.796762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f96f4a07b9f4100ed7f79cf800b040b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal\" (UID: \"1f96f4a07b9f4100ed7f79cf800b040b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.796889 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.796765    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1f96f4a07b9f4100ed7f79cf800b040b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal\" (UID: \"1f96f4a07b9f4100ed7f79cf800b040b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.894158 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.894079    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found"
Jul 27 17:24:17.903494 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.903472    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.909080 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:17.908843    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal"
Jul 27 17:24:17.994778 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:17.994740    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found"
Jul 27 17:24:18.095183 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:18.095153    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found"
Jul 27 17:24:18.195374 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:18.195282    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found"
Jul 27 17:24:18.240595 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.240559    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:24:18.263829 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.263808    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:24:18.293104 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.293085    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:24:18.295286 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.295270    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal"
Jul 27 17:24:18.304217 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.304200    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 17:24:18.305331 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.305319    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal"
Jul 27 17:24:18.315989 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.315977    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 17:24:18.328122 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.328104    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 17:24:18.328235 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.328215    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 17:24:18.328291 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.328246    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 17:24:18.328339 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.328287    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 17:24:18.367514 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.367489    2580 apiserver.go:52] "Watching apiserver"
Jul 27 17:24:18.376496 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.376472    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 17:24:18.378913 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.378885    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-bvhpw","kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal","openshift-dns/node-resolver-trb87","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal","openshift-multus/multus-additional-cni-plugins-lr6rh","openshift-network-diagnostics/network-check-target-jljqh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4","openshift-cluster-node-tuning-operator/tuned-hjktq","openshift-image-registry/node-ca-rwn2d","openshift-multus/multus-z2lls","openshift-multus/network-metrics-daemon-h66wv","openshift-network-operator/iptables-alerter-n9mjw","openshift-ovn-kubernetes/ovnkube-node-z926n","kube-system/global-pull-secret-syncer-g285v"]
Jul 27 17:24:18.381757 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.381739    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.384053 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.384033    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rwn2d"
Jul 27 17:24:18.384506 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.384488    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 17:24:18.384591 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.384547    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 17:24:18.384591 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.384554    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 17:24:18.384806 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.384790    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2rvkz\""
Jul 27 17:24:18.386348 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.386333    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bvhpw"
Jul 27 17:24:18.386592 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.386546    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 17:24:18.386814 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.386796    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 17:24:18.387229 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.387210    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 17:24:18.387344 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.387269    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hrwf2\""
Jul 27 17:24:18.388809 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.388789    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9j9hw\""
Jul 27 17:24:18.388906 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.388890    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.389206 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.389187    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 17:24:18.389344 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.389325    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 17:24:18.391178 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.391164    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:18.391242 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:18.391224    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:18.393280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.393066    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 17:24:18.393280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.393198    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 17:24:18.393664 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.393356    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 17:24:18.393664 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.393491    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 17:24:18.393664 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.393521    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 17:24:18.394687 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.394063    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-trb87"
Jul 27 17:24:18.394826 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.394809    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 17:24:18.395759 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.395728    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bxttk\""
Jul 27 17:24:18.396653 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.396608    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 17:24:18.396925 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.396905    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fs5dv\""
Jul 27 17:24:18.397024 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.396952    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.397160 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.397144    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 17:24:18.399214 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399192    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xfx2\" (UniqueName: \"kubernetes.io/projected/b18fd914-4db8-475c-ac98-4d024ab840b3-kube-api-access-6xfx2\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.399288 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399222    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-kubernetes\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.399288 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-lib-modules\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.399288 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-host\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.399288 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjq8m\" (UniqueName: \"kubernetes.io/projected/ce020319-484a-4868-86f5-4bb9683bac2f-kube-api-access-tjq8m\") pod \"node-ca-rwn2d\" (UID: \"ce020319-484a-4868-86f5-4bb9683bac2f\") " pod="openshift-image-registry/node-ca-rwn2d"
Jul 27 17:24:18.399464 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-device-dir\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.399464 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399367    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-tuned\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.399464 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-socket-dir\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.399464 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399436    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b18fd914-4db8-475c-ac98-4d024ab840b3-cnibin\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.399464 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399439    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.399464 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399460    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-sys\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.399750 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-modprobe-d\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.399750 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399511    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-kubelet-dir\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.399750 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-etc-selinux\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.399750 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ac14a62-8827-4d06-a67d-2ac290fb0ae7-hosts-file\") pod \"node-resolver-trb87\" (UID: \"5ac14a62-8827-4d06-a67d-2ac290fb0ae7\") " pod="openshift-dns/node-resolver-trb87"
Jul 27 17:24:18.399750 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ac14a62-8827-4d06-a67d-2ac290fb0ae7-tmp-dir\") pod \"node-resolver-trb87\" (UID: \"5ac14a62-8827-4d06-a67d-2ac290fb0ae7\") " pod="openshift-dns/node-resolver-trb87"
Jul 27 17:24:18.399750 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399649    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-sysconfig\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.399750 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-systemd\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.399750 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce020319-484a-4868-86f5-4bb9683bac2f-serviceca\") pod \"node-ca-rwn2d\" (UID: \"ce020319-484a-4868-86f5-4bb9683bac2f\") " pod="openshift-image-registry/node-ca-rwn2d"
Jul 27 17:24:18.399750 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399733    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c363bcd6-1a11-4e08-911a-74e0c07685c1-agent-certs\") pod \"konnectivity-agent-bvhpw\" (UID: \"c363bcd6-1a11-4e08-911a-74e0c07685c1\") " pod="kube-system/konnectivity-agent-bvhpw"
Jul 27 17:24:18.399750 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399756    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-run\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.400079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbqrt\" (UniqueName: \"kubernetes.io/projected/d1b64542-2d00-4778-b6fa-979fc0acc04d-kube-api-access-vbqrt\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.400079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399816    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-sys-fs\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.400079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399835    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-registration-dir\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.400079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b18fd914-4db8-475c-ac98-4d024ab840b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.400079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399867    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b18fd914-4db8-475c-ac98-4d024ab840b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.400079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdwrk\" (UniqueName: \"kubernetes.io/projected/5ac14a62-8827-4d06-a67d-2ac290fb0ae7-kube-api-access-zdwrk\") pod \"node-resolver-trb87\" (UID: \"5ac14a62-8827-4d06-a67d-2ac290fb0ae7\") " pod="openshift-dns/node-resolver-trb87"
Jul 27 17:24:18.400079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-sysctl-d\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.400079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-sysctl-conf\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.400079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399975    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce020319-484a-4868-86f5-4bb9683bac2f-host\") pod \"node-ca-rwn2d\" (UID: \"ce020319-484a-4868-86f5-4bb9683bac2f\") " pod="openshift-image-registry/node-ca-rwn2d"
Jul 27 17:24:18.400079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.399999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c363bcd6-1a11-4e08-911a-74e0c07685c1-konnectivity-ca\") pod \"konnectivity-agent-bvhpw\" (UID: \"c363bcd6-1a11-4e08-911a-74e0c07685c1\") " pod="kube-system/konnectivity-agent-bvhpw"
Jul 27 17:24:18.400079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.400024    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b18fd914-4db8-475c-ac98-4d024ab840b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.400079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.400048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-var-lib-kubelet\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.400079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.400074    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x6z2\" (UniqueName: \"kubernetes.io/projected/bb8c0306-b173-4f3c-8764-382e8625a572-kube-api-access-9x6z2\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.400519 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.400102    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtsjk\" (UniqueName: \"kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk\") pod \"network-check-target-jljqh\" (UID: \"1f624899-5fbc-4977-94c6-6804349ae457\") " pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:18.400519 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.400134    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1b64542-2d00-4778-b6fa-979fc0acc04d-tmp\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.400519 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.400152    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b18fd914-4db8-475c-ac98-4d024ab840b3-system-cni-dir\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.400519 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.400169    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b18fd914-4db8-475c-ac98-4d024ab840b3-os-release\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.400519 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.400191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b18fd914-4db8-475c-ac98-4d024ab840b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.400784 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.400520    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 17:24:18.400784 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.400756    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-695n9\""
Jul 27 17:24:18.401317 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.401296    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:24:18.401998 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.401935    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:18.402052 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:18.402017    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:18.402155 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.402136    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 17:24:18.403036 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.403019    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6jhmf\""
Jul 27 17:24:18.404454 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.404437    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n9mjw"
Jul 27 17:24:18.407037 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.407019    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.409400 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.409380    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:18.409490 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:18.409445    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:18.422787 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.422768    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 17:24:18.423156 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.423141    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:24:18.423286 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.423274    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 17:24:18.423408 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.423397    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 17:24:18.423898 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.423884    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 17:24:18.424047 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.424034    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 17:24:18.424183 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.424172    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 17:24:18.424333 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.424322    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d4fgj\""
Jul 27 17:24:18.424483 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.424470    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vcrzv\""
Jul 27 17:24:18.424612 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.424600    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 17:24:18.424769 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.424756    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 17:24:18.427224 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.427185    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 17:19:17 +0000 UTC" deadline="2028-02-17 18:15:36.558467644 +0000 UTC"
Jul 27 17:24:18.427271 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.427225    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13680h51m18.131245122s"
Jul 27 17:24:18.428911 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.428886    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 17:24:18.459052 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.459034    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-chlh5"
Jul 27 17:24:18.469631 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.469613    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-chlh5"
Jul 27 17:24:18.497048 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.497022    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 17:24:18.500774 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.500756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-sysctl-d\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.500843 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.500782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-sysctl-conf\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.500843 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.500803    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0298f962-c37b-4373-b625-3e715ad20b6a-host-slash\") pod \"iptables-alerter-n9mjw\" (UID: \"0298f962-c37b-4373-b625-3e715ad20b6a\") " pod="openshift-network-operator/iptables-alerter-n9mjw"
Jul 27 17:24:18.500941 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.500828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-system-cni-dir\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.500941 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.500866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce020319-484a-4868-86f5-4bb9683bac2f-host\") pod \"node-ca-rwn2d\" (UID: \"ce020319-484a-4868-86f5-4bb9683bac2f\") " pod="openshift-image-registry/node-ca-rwn2d"
Jul 27 17:24:18.500941 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.500889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b18fd914-4db8-475c-ac98-4d024ab840b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.500941 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.500910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-var-lib-kubelet\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.501139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.500953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0298f962-c37b-4373-b625-3e715ad20b6a-iptables-alerter-script\") pod \"iptables-alerter-n9mjw\" (UID: \"0298f962-c37b-4373-b625-3e715ad20b6a\") " pod="openshift-network-operator/iptables-alerter-n9mjw"
Jul 27 17:24:18.501139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.500954    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce020319-484a-4868-86f5-4bb9683bac2f-host\") pod \"node-ca-rwn2d\" (UID: \"ce020319-484a-4868-86f5-4bb9683bac2f\") " pod="openshift-image-registry/node-ca-rwn2d"
Jul 27 17:24:18.501139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.500981    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-sysctl-conf\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.501139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.500955    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-sysctl-d\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.501139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.500989    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tqtt\" (UniqueName: \"kubernetes.io/projected/06143fc2-1884-4652-b9ba-20b433e4febc-kube-api-access-9tqtt\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.501139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501045    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-log-socket\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.501139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501072    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b18fd914-4db8-475c-ac98-4d024ab840b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.501139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1b64542-2d00-4778-b6fa-979fc0acc04d-tmp\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.501139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501108    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-var-lib-cni-bin\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.501139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501136    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-var-lib-cni-multus\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501166    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-multus-conf-dir\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-kubelet\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501220    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-etc-openvswitch\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501247    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501279    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b18fd914-4db8-475c-ac98-4d024ab840b3-os-release\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501304    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-lib-modules\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-host\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501360    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-cni-netd\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-device-dir\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501418    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b18fd914-4db8-475c-ac98-4d024ab840b3-os-release\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501435    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-run-openvswitch\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501441    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-lib-modules\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501484    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-cni-bin\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501506    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-var-lib-kubelet\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501528    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/268328d8-17e6-4980-b517-73cd00a35a5d-env-overrides\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-kubelet-config\") pod \"global-pull-secret-syncer-g285v\" (UID: \"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4\") " pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:18.501623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501593    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-device-dir\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501605    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b18fd914-4db8-475c-ac98-4d024ab840b3-cnibin\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-sys\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501690    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b18fd914-4db8-475c-ac98-4d024ab840b3-cnibin\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501689    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs\") pod \"network-metrics-daemon-h66wv\" (UID: \"5531f102-84da-411c-99df-840e1f4b871a\") " pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-cnibin\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501747    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-sys\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-run\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501778    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-modprobe-d\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-modprobe-d\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/268328d8-17e6-4980-b517-73cd00a35a5d-ovnkube-config\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501897    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-host\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501915    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce020319-484a-4868-86f5-4bb9683bac2f-serviceca\") pod \"node-ca-rwn2d\" (UID: \"ce020319-484a-4868-86f5-4bb9683bac2f\") " pod="openshift-image-registry/node-ca-rwn2d"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501915    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-run\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c363bcd6-1a11-4e08-911a-74e0c07685c1-agent-certs\") pod \"konnectivity-agent-bvhpw\" (UID: \"c363bcd6-1a11-4e08-911a-74e0c07685c1\") " pod="kube-system/konnectivity-agent-bvhpw"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-hostroot\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.501996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-slash\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.502446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502020    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-run-systemd\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.503622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502053    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-dbus\") pod \"global-pull-secret-syncer-g285v\" (UID: \"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4\") " pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:18.503622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-sys-fs\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.503622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502166    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b18fd914-4db8-475c-ac98-4d024ab840b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.503622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502203    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6tfv\" (UniqueName: \"kubernetes.io/projected/0298f962-c37b-4373-b625-3e715ad20b6a-kube-api-access-t6tfv\") pod \"iptables-alerter-n9mjw\" (UID: \"0298f962-c37b-4373-b625-3e715ad20b6a\") " pod="openshift-network-operator/iptables-alerter-n9mjw"
Jul 27 17:24:18.503622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502228    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06143fc2-1884-4652-b9ba-20b433e4febc-multus-daemon-config\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.503622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502245    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-sys-fs\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.503622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c363bcd6-1a11-4e08-911a-74e0c07685c1-konnectivity-ca\") pod \"konnectivity-agent-bvhpw\" (UID: \"c363bcd6-1a11-4e08-911a-74e0c07685c1\") " pod="kube-system/konnectivity-agent-bvhpw"
Jul 27 17:24:18.503622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502289    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-var-lib-openvswitch\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.503622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502337    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-run-ovn\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.503622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502376    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/268328d8-17e6-4980-b517-73cd00a35a5d-ovn-node-metrics-cert\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.503622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502425    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x6z2\" (UniqueName: \"kubernetes.io/projected/bb8c0306-b173-4f3c-8764-382e8625a572-kube-api-access-9x6z2\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.503622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce020319-484a-4868-86f5-4bb9683bac2f-serviceca\") pod \"node-ca-rwn2d\" (UID: \"ce020319-484a-4868-86f5-4bb9683bac2f\") " pod="openshift-image-registry/node-ca-rwn2d"
Jul 27 17:24:18.503622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502471    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtsjk\" (UniqueName: \"kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk\") pod \"network-check-target-jljqh\" (UID: \"1f624899-5fbc-4977-94c6-6804349ae457\") " pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:18.503622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/268328d8-17e6-4980-b517-73cd00a35a5d-ovnkube-script-lib\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.503622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502557    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret\") pod \"global-pull-secret-syncer-g285v\" (UID: \"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4\") " pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:18.503622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b18fd914-4db8-475c-ac98-4d024ab840b3-system-cni-dir\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502639    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b18fd914-4db8-475c-ac98-4d024ab840b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502710    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b18fd914-4db8-475c-ac98-4d024ab840b3-system-cni-dir\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xfx2\" (UniqueName: \"kubernetes.io/projected/b18fd914-4db8-475c-ac98-4d024ab840b3-kube-api-access-6xfx2\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-kubernetes\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502832    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-run-netns\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502861    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwvbv\" (UniqueName: \"kubernetes.io/projected/268328d8-17e6-4980-b517-73cd00a35a5d-kube-api-access-mwvbv\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502887    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c363bcd6-1a11-4e08-911a-74e0c07685c1-konnectivity-ca\") pod \"konnectivity-agent-bvhpw\" (UID: \"c363bcd6-1a11-4e08-911a-74e0c07685c1\") " pod="kube-system/konnectivity-agent-bvhpw"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502909    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjq8m\" (UniqueName: \"kubernetes.io/projected/ce020319-484a-4868-86f5-4bb9683bac2f-kube-api-access-tjq8m\") pod \"node-ca-rwn2d\" (UID: \"ce020319-484a-4868-86f5-4bb9683bac2f\") " pod="openshift-image-registry/node-ca-rwn2d"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-tuned\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502980    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06143fc2-1884-4652-b9ba-20b433e4febc-cni-binary-copy\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.502985    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-kubernetes\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-run-netns\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503093    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-run-multus-certs\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-node-log\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503180    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-socket-dir\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.504359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503237    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b18fd914-4db8-475c-ac98-4d024ab840b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-multus-cni-dir\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503269    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-os-release\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-var-lib-kubelet\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503329    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-etc-kubernetes\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503349    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-socket-dir\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503358    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spmxv\" (UniqueName: \"kubernetes.io/projected/5531f102-84da-411c-99df-840e1f4b871a-kube-api-access-spmxv\") pod \"network-metrics-daemon-h66wv\" (UID: \"5531f102-84da-411c-99df-840e1f4b871a\") " pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-run-k8s-cni-cncf-io\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-kubelet-dir\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-etc-selinux\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ac14a62-8827-4d06-a67d-2ac290fb0ae7-hosts-file\") pod \"node-resolver-trb87\" (UID: \"5ac14a62-8827-4d06-a67d-2ac290fb0ae7\") " pod="openshift-dns/node-resolver-trb87"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503577    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ac14a62-8827-4d06-a67d-2ac290fb0ae7-tmp-dir\") pod \"node-resolver-trb87\" (UID: \"5ac14a62-8827-4d06-a67d-2ac290fb0ae7\") " pod="openshift-dns/node-resolver-trb87"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503617    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-sysconfig\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503647    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbqrt\" (UniqueName: \"kubernetes.io/projected/d1b64542-2d00-4778-b6fa-979fc0acc04d-kube-api-access-vbqrt\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503666    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ac14a62-8827-4d06-a67d-2ac290fb0ae7-hosts-file\") pod \"node-resolver-trb87\" (UID: \"5ac14a62-8827-4d06-a67d-2ac290fb0ae7\") " pod="openshift-dns/node-resolver-trb87"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-multus-socket-dir-parent\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-systemd\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.505082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-systemd-units\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.505768 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503747    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b18fd914-4db8-475c-ac98-4d024ab840b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.505768 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503764    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-etc-selinux\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.505768 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-registration-dir\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.505768 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-kubelet-dir\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.505768 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b18fd914-4db8-475c-ac98-4d024ab840b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.505768 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503833    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-sysconfig\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.505768 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdwrk\" (UniqueName: \"kubernetes.io/projected/5ac14a62-8827-4d06-a67d-2ac290fb0ae7-kube-api-access-zdwrk\") pod \"node-resolver-trb87\" (UID: \"5ac14a62-8827-4d06-a67d-2ac290fb0ae7\") " pod="openshift-dns/node-resolver-trb87"
Jul 27 17:24:18.505768 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.503962    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-systemd\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.505768 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.504037    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ac14a62-8827-4d06-a67d-2ac290fb0ae7-tmp-dir\") pod \"node-resolver-trb87\" (UID: \"5ac14a62-8827-4d06-a67d-2ac290fb0ae7\") " pod="openshift-dns/node-resolver-trb87"
Jul 27 17:24:18.505768 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.504119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb8c0306-b173-4f3c-8764-382e8625a572-registration-dir\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.505768 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.504505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b18fd914-4db8-475c-ac98-4d024ab840b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.506253 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.505813    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d1b64542-2d00-4778-b6fa-979fc0acc04d-etc-tuned\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.506253 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.505878    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1b64542-2d00-4778-b6fa-979fc0acc04d-tmp\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.506253 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.506008    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c363bcd6-1a11-4e08-911a-74e0c07685c1-agent-certs\") pod \"konnectivity-agent-bvhpw\" (UID: \"c363bcd6-1a11-4e08-911a-74e0c07685c1\") " pod="kube-system/konnectivity-agent-bvhpw"
Jul 27 17:24:18.512534 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:18.512493    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:24:18.512534 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:18.512526    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:24:18.512792 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:18.512541    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xtsjk for pod openshift-network-diagnostics/network-check-target-jljqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:24:18.512792 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:18.512617    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk podName:1f624899-5fbc-4977-94c6-6804349ae457 nodeName:}" failed. No retries permitted until 2026-07-27 17:24:19.012594574 +0000 UTC m=+2.027261000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xtsjk" (UniqueName: "kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk") pod "network-check-target-jljqh" (UID: "1f624899-5fbc-4977-94c6-6804349ae457") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:24:18.515906 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.515874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjq8m\" (UniqueName: \"kubernetes.io/projected/ce020319-484a-4868-86f5-4bb9683bac2f-kube-api-access-tjq8m\") pod \"node-ca-rwn2d\" (UID: \"ce020319-484a-4868-86f5-4bb9683bac2f\") " pod="openshift-image-registry/node-ca-rwn2d"
Jul 27 17:24:18.517319 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.517298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x6z2\" (UniqueName: \"kubernetes.io/projected/bb8c0306-b173-4f3c-8764-382e8625a572-kube-api-access-9x6z2\") pod \"aws-ebs-csi-driver-node-htwb4\" (UID: \"bb8c0306-b173-4f3c-8764-382e8625a572\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.517402 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.517333    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xfx2\" (UniqueName: \"kubernetes.io/projected/b18fd914-4db8-475c-ac98-4d024ab840b3-kube-api-access-6xfx2\") pod \"multus-additional-cni-plugins-lr6rh\" (UID: \"b18fd914-4db8-475c-ac98-4d024ab840b3\") " pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.517538 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.517515    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbqrt\" (UniqueName: \"kubernetes.io/projected/d1b64542-2d00-4778-b6fa-979fc0acc04d-kube-api-access-vbqrt\") pod \"tuned-hjktq\" (UID: \"d1b64542-2d00-4778-b6fa-979fc0acc04d\") " pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.518952 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.518931    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdwrk\" (UniqueName: \"kubernetes.io/projected/5ac14a62-8827-4d06-a67d-2ac290fb0ae7-kube-api-access-zdwrk\") pod \"node-resolver-trb87\" (UID: \"5ac14a62-8827-4d06-a67d-2ac290fb0ae7\") " pod="openshift-dns/node-resolver-trb87"
Jul 27 17:24:18.604126 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0298f962-c37b-4373-b625-3e715ad20b6a-host-slash\") pod \"iptables-alerter-n9mjw\" (UID: \"0298f962-c37b-4373-b625-3e715ad20b6a\") " pod="openshift-network-operator/iptables-alerter-n9mjw"
Jul 27 17:24:18.604240 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-system-cni-dir\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.604240 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604171    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0298f962-c37b-4373-b625-3e715ad20b6a-iptables-alerter-script\") pod \"iptables-alerter-n9mjw\" (UID: \"0298f962-c37b-4373-b625-3e715ad20b6a\") " pod="openshift-network-operator/iptables-alerter-n9mjw"
Jul 27 17:24:18.604240 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tqtt\" (UniqueName: \"kubernetes.io/projected/06143fc2-1884-4652-b9ba-20b433e4febc-kube-api-access-9tqtt\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.604240 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604213    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0298f962-c37b-4373-b625-3e715ad20b6a-host-slash\") pod \"iptables-alerter-n9mjw\" (UID: \"0298f962-c37b-4373-b625-3e715ad20b6a\") " pod="openshift-network-operator/iptables-alerter-n9mjw"
Jul 27 17:24:18.604240 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-log-socket\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.604491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604263    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-log-socket\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.604491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-var-lib-cni-bin\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.604491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604305    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-var-lib-cni-bin\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.604491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-var-lib-cni-multus\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.604491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604340    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-multus-conf-dir\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.604491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-system-cni-dir\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.604491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604365    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-kubelet\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.604491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604347    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-var-lib-cni-multus\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.604491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-etc-openvswitch\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.604491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604434    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-etc-openvswitch\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.604491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604436    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-multus-conf-dir\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.604491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-kubelet\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.604491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604518    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-cni-netd\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604565    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-run-openvswitch\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-cni-bin\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604576    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-cni-netd\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604619    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/268328d8-17e6-4980-b517-73cd00a35a5d-env-overrides\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604624    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-run-openvswitch\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-kubelet-config\") pod \"global-pull-secret-syncer-g285v\" (UID: \"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4\") " pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604652    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-cni-bin\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604708    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-kubelet-config\") pod \"global-pull-secret-syncer-g285v\" (UID: \"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4\") " pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604741    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs\") pod \"network-metrics-daemon-h66wv\" (UID: \"5531f102-84da-411c-99df-840e1f4b871a\") " pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604770    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-cnibin\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/268328d8-17e6-4980-b517-73cd00a35a5d-ovnkube-config\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604822    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-hostroot\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-slash\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-run-systemd\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:18.604885    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:24:18.605151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604899    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-dbus\") pod \"global-pull-secret-syncer-g285v\" (UID: \"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4\") " pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604908    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-hostroot\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604928    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6tfv\" (UniqueName: \"kubernetes.io/projected/0298f962-c37b-4373-b625-3e715ad20b6a-kube-api-access-t6tfv\") pod \"iptables-alerter-n9mjw\" (UID: \"0298f962-c37b-4373-b625-3e715ad20b6a\") " pod="openshift-network-operator/iptables-alerter-n9mjw"
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06143fc2-1884-4652-b9ba-20b433e4febc-multus-daemon-config\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:18.604982    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs podName:5531f102-84da-411c-99df-840e1f4b871a nodeName:}" failed. No retries permitted until 2026-07-27 17:24:19.104958786 +0000 UTC m=+2.119625228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs") pod "network-metrics-daemon-h66wv" (UID: "5531f102-84da-411c-99df-840e1f4b871a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-var-lib-openvswitch\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605030    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-slash\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-run-ovn\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/268328d8-17e6-4980-b517-73cd00a35a5d-ovn-node-metrics-cert\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-run-systemd\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.604875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-cnibin\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/268328d8-17e6-4980-b517-73cd00a35a5d-ovnkube-script-lib\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605129    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0298f962-c37b-4373-b625-3e715ad20b6a-iptables-alerter-script\") pod \"iptables-alerter-n9mjw\" (UID: \"0298f962-c37b-4373-b625-3e715ad20b6a\") " pod="openshift-network-operator/iptables-alerter-n9mjw"
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret\") pod \"global-pull-secret-syncer-g285v\" (UID: \"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4\") " pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605156    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/268328d8-17e6-4980-b517-73cd00a35a5d-env-overrides\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-run-netns\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwvbv\" (UniqueName: \"kubernetes.io/projected/268328d8-17e6-4980-b517-73cd00a35a5d-kube-api-access-mwvbv\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.606065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-run-ovn\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06143fc2-1884-4652-b9ba-20b433e4febc-cni-binary-copy\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605216    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-dbus\") pod \"global-pull-secret-syncer-g285v\" (UID: \"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4\") " pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605260    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-run-netns\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605288    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-var-lib-openvswitch\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-run-multus-certs\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-node-log\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605332    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-run-multus-certs\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:18.605388    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-multus-cni-dir\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605399    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/268328d8-17e6-4980-b517-73cd00a35a5d-ovnkube-config\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-os-release\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605463    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-var-lib-kubelet\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605498    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-etc-kubernetes\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605530    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spmxv\" (UniqueName: \"kubernetes.io/projected/5531f102-84da-411c-99df-840e1f4b871a-kube-api-access-spmxv\") pod \"network-metrics-daemon-h66wv\" (UID: \"5531f102-84da-411c-99df-840e1f4b871a\") " pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:18.605588    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret podName:f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4 nodeName:}" failed. No retries permitted until 2026-07-27 17:24:19.105553943 +0000 UTC m=+2.120220393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret") pod "global-pull-secret-syncer-g285v" (UID: "f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:24:18.606739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-run-k8s-cni-cncf-io\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.607280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-multus-socket-dir-parent\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.607280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-systemd-units\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.607280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605765    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-multus-cni-dir\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.607280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-os-release\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.607280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605431    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-run-netns\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.607280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605387    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-run-netns\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.607280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-etc-kubernetes\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.607280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605896    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-multus-socket-dir-parent\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.607280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605931    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-node-log\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.607280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605947    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.607280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.605977    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/268328d8-17e6-4980-b517-73cd00a35a5d-systemd-units\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.607280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.606014    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-var-lib-kubelet\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.607280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.606053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06143fc2-1884-4652-b9ba-20b433e4febc-host-run-k8s-cni-cncf-io\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.607280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.606307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/268328d8-17e6-4980-b517-73cd00a35a5d-ovnkube-script-lib\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.607280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.606668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06143fc2-1884-4652-b9ba-20b433e4febc-multus-daemon-config\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.607280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.606672    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06143fc2-1884-4652-b9ba-20b433e4febc-cni-binary-copy\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.607888 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.607845    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/268328d8-17e6-4980-b517-73cd00a35a5d-ovn-node-metrics-cert\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.613731 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.613697    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tqtt\" (UniqueName: \"kubernetes.io/projected/06143fc2-1884-4652-b9ba-20b433e4febc-kube-api-access-9tqtt\") pod \"multus-z2lls\" (UID: \"06143fc2-1884-4652-b9ba-20b433e4febc\") " pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.613872 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.613855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6tfv\" (UniqueName: \"kubernetes.io/projected/0298f962-c37b-4373-b625-3e715ad20b6a-kube-api-access-t6tfv\") pod \"iptables-alerter-n9mjw\" (UID: \"0298f962-c37b-4373-b625-3e715ad20b6a\") " pod="openshift-network-operator/iptables-alerter-n9mjw"
Jul 27 17:24:18.613993 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.613970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwvbv\" (UniqueName: \"kubernetes.io/projected/268328d8-17e6-4980-b517-73cd00a35a5d-kube-api-access-mwvbv\") pod \"ovnkube-node-z926n\" (UID: \"268328d8-17e6-4980-b517-73cd00a35a5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.615289 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.615267    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spmxv\" (UniqueName: \"kubernetes.io/projected/5531f102-84da-411c-99df-840e1f4b871a-kube-api-access-spmxv\") pod \"network-metrics-daemon-h66wv\" (UID: \"5531f102-84da-411c-99df-840e1f4b871a\") " pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:18.618864 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:18.618839    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f96f4a07b9f4100ed7f79cf800b040b.slice/crio-dd603a8adc67b6ad37aa3b76407d0761cb6e167f240d4106c1bc0987739fd223 WatchSource:0}: Error finding container dd603a8adc67b6ad37aa3b76407d0761cb6e167f240d4106c1bc0987739fd223: Status 404 returned error can't find the container with id dd603a8adc67b6ad37aa3b76407d0761cb6e167f240d4106c1bc0987739fd223
Jul 27 17:24:18.624803 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.624784    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:24:18.626227 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:18.626208    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a61dacdec00e617530332f7c59343be.slice/crio-e84dd85ef9ad6fe7d783546e86fff0377536beae852578ff34fb154198b6651b WatchSource:0}: Error finding container e84dd85ef9ad6fe7d783546e86fff0377536beae852578ff34fb154198b6651b: Status 404 returned error can't find the container with id e84dd85ef9ad6fe7d783546e86fff0377536beae852578ff34fb154198b6651b
Jul 27 17:24:18.716497 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.716403    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4"
Jul 27 17:24:18.722749 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.722724    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rwn2d"
Jul 27 17:24:18.727226 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:18.727200    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb8c0306_b173_4f3c_8764_382e8625a572.slice/crio-cfaf05e24960c17cedc49c46e2e66378d576fc58a388cfd7928678f358338d5b WatchSource:0}: Error finding container cfaf05e24960c17cedc49c46e2e66378d576fc58a388cfd7928678f358338d5b: Status 404 returned error can't find the container with id cfaf05e24960c17cedc49c46e2e66378d576fc58a388cfd7928678f358338d5b
Jul 27 17:24:18.732053 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:18.732032    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce020319_484a_4868_86f5_4bb9683bac2f.slice/crio-e154061f832b9c21ab9e4a9cb5b97841164699579fd33a9e0dea4e0089b57b95 WatchSource:0}: Error finding container e154061f832b9c21ab9e4a9cb5b97841164699579fd33a9e0dea4e0089b57b95: Status 404 returned error can't find the container with id e154061f832b9c21ab9e4a9cb5b97841164699579fd33a9e0dea4e0089b57b95
Jul 27 17:24:18.759737 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.759713    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bvhpw"
Jul 27 17:24:18.770485 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.770462    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lr6rh"
Jul 27 17:24:18.771164 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:18.770710    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc363bcd6_1a11_4e08_911a_74e0c07685c1.slice/crio-02edf05b428744da6cc2af03a4b3de14a582793b89670e8ac031bd91bf4360d7 WatchSource:0}: Error finding container 02edf05b428744da6cc2af03a4b3de14a582793b89670e8ac031bd91bf4360d7: Status 404 returned error can't find the container with id 02edf05b428744da6cc2af03a4b3de14a582793b89670e8ac031bd91bf4360d7
Jul 27 17:24:18.778998 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:18.778969    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18fd914_4db8_475c_ac98_4d024ab840b3.slice/crio-cb86f6ae9ba820b61bd3184880377e0c478612fbb00ee573cc8479b2913942f1 WatchSource:0}: Error finding container cb86f6ae9ba820b61bd3184880377e0c478612fbb00ee573cc8479b2913942f1: Status 404 returned error can't find the container with id cb86f6ae9ba820b61bd3184880377e0c478612fbb00ee573cc8479b2913942f1
Jul 27 17:24:18.785116 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.785099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-trb87"
Jul 27 17:24:18.793326 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:18.793307    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac14a62_8827_4d06_a67d_2ac290fb0ae7.slice/crio-d79f612f9d6583e6ef4955da61b240b9a459341337ccd32cbbc749ac7683931d WatchSource:0}: Error finding container d79f612f9d6583e6ef4955da61b240b9a459341337ccd32cbbc749ac7683931d: Status 404 returned error can't find the container with id d79f612f9d6583e6ef4955da61b240b9a459341337ccd32cbbc749ac7683931d
Jul 27 17:24:18.801095 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.801075    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hjktq"
Jul 27 17:24:18.809113 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:18.809094    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1b64542_2d00_4778_b6fa_979fc0acc04d.slice/crio-7ced7158aa70d9e2029897d243948f93c619b324d2fd5ac264a2992edf49bc1b WatchSource:0}: Error finding container 7ced7158aa70d9e2029897d243948f93c619b324d2fd5ac264a2992edf49bc1b: Status 404 returned error can't find the container with id 7ced7158aa70d9e2029897d243948f93c619b324d2fd5ac264a2992edf49bc1b
Jul 27 17:24:18.831697 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.831674    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z2lls"
Jul 27 17:24:18.840011 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:18.839983    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06143fc2_1884_4652_b9ba_20b433e4febc.slice/crio-cf07498e46e35424a85cdb8d3e4622a0999da371f37f2d6ee27be7ec2fcb5ae5 WatchSource:0}: Error finding container cf07498e46e35424a85cdb8d3e4622a0999da371f37f2d6ee27be7ec2fcb5ae5: Status 404 returned error can't find the container with id cf07498e46e35424a85cdb8d3e4622a0999da371f37f2d6ee27be7ec2fcb5ae5
Jul 27 17:24:18.847982 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.847963    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n9mjw"
Jul 27 17:24:18.852841 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:18.852820    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:18.857440 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:18.857417    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0298f962_c37b_4373_b625_3e715ad20b6a.slice/crio-903d5d23e4a49a8115a70a723f71a419932b58adbf3a097f259f12369143a2e8 WatchSource:0}: Error finding container 903d5d23e4a49a8115a70a723f71a419932b58adbf3a097f259f12369143a2e8: Status 404 returned error can't find the container with id 903d5d23e4a49a8115a70a723f71a419932b58adbf3a097f259f12369143a2e8
Jul 27 17:24:18.862356 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:18.862325    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268328d8_17e6_4980_b517_73cd00a35a5d.slice/crio-faade8ae3679b0a978f1b1be1808ddb48d67ba2f7cfa0e31d1cc6631346b23c8 WatchSource:0}: Error finding container faade8ae3679b0a978f1b1be1808ddb48d67ba2f7cfa0e31d1cc6631346b23c8: Status 404 returned error can't find the container with id faade8ae3679b0a978f1b1be1808ddb48d67ba2f7cfa0e31d1cc6631346b23c8
Jul 27 17:24:19.109415 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.109315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs\") pod \"network-metrics-daemon-h66wv\" (UID: \"5531f102-84da-411c-99df-840e1f4b871a\") " pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:19.109415 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.109369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtsjk\" (UniqueName: \"kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk\") pod \"network-check-target-jljqh\" (UID: \"1f624899-5fbc-4977-94c6-6804349ae457\") " pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:19.109415 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.109397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret\") pod \"global-pull-secret-syncer-g285v\" (UID: \"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4\") " pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:19.109718 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:19.109458    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:24:19.109718 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:19.109510    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:24:19.109718 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:19.109532    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs podName:5531f102-84da-411c-99df-840e1f4b871a nodeName:}" failed. No retries permitted until 2026-07-27 17:24:20.109513939 +0000 UTC m=+3.124180385 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs") pod "network-metrics-daemon-h66wv" (UID: "5531f102-84da-411c-99df-840e1f4b871a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:24:19.109718 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:19.109537    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:24:19.109718 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:19.109560    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:24:19.109718 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:19.109561    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret podName:f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4 nodeName:}" failed. No retries permitted until 2026-07-27 17:24:20.109544857 +0000 UTC m=+3.124211300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret") pod "global-pull-secret-syncer-g285v" (UID: "f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:24:19.109718 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:19.109573    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xtsjk for pod openshift-network-diagnostics/network-check-target-jljqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:24:19.109718 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:19.109639    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk podName:1f624899-5fbc-4977-94c6-6804349ae457 nodeName:}" failed. No retries permitted until 2026-07-27 17:24:20.109623775 +0000 UTC m=+3.124290215 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtsjk" (UniqueName: "kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk") pod "network-check-target-jljqh" (UID: "1f624899-5fbc-4977-94c6-6804349ae457") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:24:19.473800 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.473716    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 17:19:18 +0000 UTC" deadline="2028-03-23 20:58:04.496887204 +0000 UTC"
Jul 27 17:24:19.473800 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.473782    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14523h33m45.023109494s"
Jul 27 17:24:19.504529 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.504340    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4" event={"ID":"bb8c0306-b173-4f3c-8764-382e8625a572","Type":"ContainerStarted","Data":"cfaf05e24960c17cedc49c46e2e66378d576fc58a388cfd7928678f358338d5b"}
Jul 27 17:24:19.506755 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.506724    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" event={"ID":"1f96f4a07b9f4100ed7f79cf800b040b","Type":"ContainerStarted","Data":"dd603a8adc67b6ad37aa3b76407d0761cb6e167f240d4106c1bc0987739fd223"}
Jul 27 17:24:19.518821 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.518790    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z926n" event={"ID":"268328d8-17e6-4980-b517-73cd00a35a5d","Type":"ContainerStarted","Data":"faade8ae3679b0a978f1b1be1808ddb48d67ba2f7cfa0e31d1cc6631346b23c8"}
Jul 27 17:24:19.527324 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.527265    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n9mjw" event={"ID":"0298f962-c37b-4373-b625-3e715ad20b6a","Type":"ContainerStarted","Data":"903d5d23e4a49a8115a70a723f71a419932b58adbf3a097f259f12369143a2e8"}
Jul 27 17:24:19.549552 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.549480    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hjktq" event={"ID":"d1b64542-2d00-4778-b6fa-979fc0acc04d","Type":"ContainerStarted","Data":"7ced7158aa70d9e2029897d243948f93c619b324d2fd5ac264a2992edf49bc1b"}
Jul 27 17:24:19.556723 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.556633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lr6rh" event={"ID":"b18fd914-4db8-475c-ac98-4d024ab840b3","Type":"ContainerStarted","Data":"cb86f6ae9ba820b61bd3184880377e0c478612fbb00ee573cc8479b2913942f1"}
Jul 27 17:24:19.563081 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.563039    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bvhpw" event={"ID":"c363bcd6-1a11-4e08-911a-74e0c07685c1","Type":"ContainerStarted","Data":"02edf05b428744da6cc2af03a4b3de14a582793b89670e8ac031bd91bf4360d7"}
Jul 27 17:24:19.565733 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.565707    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rwn2d" event={"ID":"ce020319-484a-4868-86f5-4bb9683bac2f","Type":"ContainerStarted","Data":"e154061f832b9c21ab9e4a9cb5b97841164699579fd33a9e0dea4e0089b57b95"}
Jul 27 17:24:19.569546 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.569513    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal" event={"ID":"0a61dacdec00e617530332f7c59343be","Type":"ContainerStarted","Data":"e84dd85ef9ad6fe7d783546e86fff0377536beae852578ff34fb154198b6651b"}
Jul 27 17:24:19.572083 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.571957    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z2lls" event={"ID":"06143fc2-1884-4652-b9ba-20b433e4febc","Type":"ContainerStarted","Data":"cf07498e46e35424a85cdb8d3e4622a0999da371f37f2d6ee27be7ec2fcb5ae5"}
Jul 27 17:24:19.575945 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.575887    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-trb87" event={"ID":"5ac14a62-8827-4d06-a67d-2ac290fb0ae7","Type":"ContainerStarted","Data":"d79f612f9d6583e6ef4955da61b240b9a459341337ccd32cbbc749ac7683931d"}
Jul 27 17:24:19.723617 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:19.723579    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:24:20.116453 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:20.116414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtsjk\" (UniqueName: \"kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk\") pod \"network-check-target-jljqh\" (UID: \"1f624899-5fbc-4977-94c6-6804349ae457\") " pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:20.116727 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:20.116470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret\") pod \"global-pull-secret-syncer-g285v\" (UID: \"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4\") " pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:20.116727 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:20.116543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs\") pod \"network-metrics-daemon-h66wv\" (UID: \"5531f102-84da-411c-99df-840e1f4b871a\") " pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:20.116727 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:20.116704    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:24:20.116927 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:20.116775    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs podName:5531f102-84da-411c-99df-840e1f4b871a nodeName:}" failed. No retries permitted until 2026-07-27 17:24:22.116751835 +0000 UTC m=+5.131418274 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs") pod "network-metrics-daemon-h66wv" (UID: "5531f102-84da-411c-99df-840e1f4b871a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:24:20.117305 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:20.117281    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:24:20.117396 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:20.117311    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:24:20.117396 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:20.117325    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xtsjk for pod openshift-network-diagnostics/network-check-target-jljqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:24:20.117396 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:20.117377    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk podName:1f624899-5fbc-4977-94c6-6804349ae457 nodeName:}" failed. No retries permitted until 2026-07-27 17:24:22.117359108 +0000 UTC m=+5.132025557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtsjk" (UniqueName: "kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk") pod "network-check-target-jljqh" (UID: "1f624899-5fbc-4977-94c6-6804349ae457") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:24:20.117569 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:20.117448    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:24:20.117569 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:20.117485    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret podName:f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4 nodeName:}" failed. No retries permitted until 2026-07-27 17:24:22.117473148 +0000 UTC m=+5.132139588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret") pod "global-pull-secret-syncer-g285v" (UID: "f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:24:20.184716 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:20.184682    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:24:20.471229 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:20.471081    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:20.471229 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:20.471220    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:20.471766 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:20.471651    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:20.471874 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:20.471779    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:20.471874 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:20.471826    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:20.471989 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:20.471874    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:20.475012 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:20.474980    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 17:19:18 +0000 UTC" deadline="2028-05-03 21:41:52.76378902 +0000 UTC"
Jul 27 17:24:20.475012 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:20.475013    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15508h17m32.288780598s"
Jul 27 17:24:20.528821 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:20.528751    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:24:22.137932 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:22.137891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs\") pod \"network-metrics-daemon-h66wv\" (UID: \"5531f102-84da-411c-99df-840e1f4b871a\") " pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:22.138421 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:22.137961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtsjk\" (UniqueName: \"kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk\") pod \"network-check-target-jljqh\" (UID: \"1f624899-5fbc-4977-94c6-6804349ae457\") " pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:22.138421 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:22.137994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret\") pod \"global-pull-secret-syncer-g285v\" (UID: \"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4\") " pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:22.138421 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:22.138132    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:24:22.138421 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:22.138192    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret podName:f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4 nodeName:}" failed. No retries permitted until 2026-07-27 17:24:26.138173408 +0000 UTC m=+9.152839838 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret") pod "global-pull-secret-syncer-g285v" (UID: "f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:24:22.138776 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:22.138618    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:24:22.138776 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:22.138683    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs podName:5531f102-84da-411c-99df-840e1f4b871a nodeName:}" failed. No retries permitted until 2026-07-27 17:24:26.138653857 +0000 UTC m=+9.153320320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs") pod "network-metrics-daemon-h66wv" (UID: "5531f102-84da-411c-99df-840e1f4b871a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:24:22.138776 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:22.138769    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:24:22.138951 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:22.138784    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:24:22.138951 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:22.138798    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xtsjk for pod openshift-network-diagnostics/network-check-target-jljqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:24:22.138951 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:22.138847    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk podName:1f624899-5fbc-4977-94c6-6804349ae457 nodeName:}" failed. No retries permitted until 2026-07-27 17:24:26.138835219 +0000 UTC m=+9.153501664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtsjk" (UniqueName: "kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk") pod "network-check-target-jljqh" (UID: "1f624899-5fbc-4977-94c6-6804349ae457") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:24:22.470295 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:22.470263    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:22.470498 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:22.470404    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:22.470890 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:22.470866    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:22.470999 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:22.470985    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:22.471079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:22.471063    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:22.471165 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:22.471147    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:24.471083 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:24.470486    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:24.471083 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:24.470598    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:24.471083 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:24.470668    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:24.471083 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:24.470728    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:24.471083 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:24.470762    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:24.471083 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:24.470801    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:26.172044 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:26.172001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs\") pod \"network-metrics-daemon-h66wv\" (UID: \"5531f102-84da-411c-99df-840e1f4b871a\") " pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:26.172467 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:26.172064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtsjk\" (UniqueName: \"kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk\") pod \"network-check-target-jljqh\" (UID: \"1f624899-5fbc-4977-94c6-6804349ae457\") " pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:26.172467 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:26.172091    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret\") pod \"global-pull-secret-syncer-g285v\" (UID: \"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4\") " pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:26.172467 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:26.172157    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:24:26.172467 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:26.172187    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:24:26.172467 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:26.172222    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs podName:5531f102-84da-411c-99df-840e1f4b871a nodeName:}" failed. No retries permitted until 2026-07-27 17:24:34.172202499 +0000 UTC m=+17.186868944 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs") pod "network-metrics-daemon-h66wv" (UID: "5531f102-84da-411c-99df-840e1f4b871a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:24:26.172467 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:26.172244    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret podName:f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4 nodeName:}" failed. No retries permitted until 2026-07-27 17:24:34.172231899 +0000 UTC m=+17.186898328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret") pod "global-pull-secret-syncer-g285v" (UID: "f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:24:26.172467 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:26.172286    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:24:26.172467 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:26.172302    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:24:26.172467 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:26.172314    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xtsjk for pod openshift-network-diagnostics/network-check-target-jljqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:24:26.172467 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:26.172349    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk podName:1f624899-5fbc-4977-94c6-6804349ae457 nodeName:}" failed. No retries permitted until 2026-07-27 17:24:34.172338378 +0000 UTC m=+17.187004817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtsjk" (UniqueName: "kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk") pod "network-check-target-jljqh" (UID: "1f624899-5fbc-4977-94c6-6804349ae457") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:24:26.470713 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:26.470638    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:26.470713 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:26.470656    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:26.470713 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:26.470656    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:26.470990 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:26.470783    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:26.470990 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:26.470909    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:26.471080 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:26.470999    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:28.470267 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:28.470233    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:28.470267 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:28.470269    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:28.470816 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:28.470238    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:28.470816 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:28.470373    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:28.470816 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:28.470473    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:28.470816 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:28.470549    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:30.470527 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:30.470453    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:30.470527 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:30.470512    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:30.471061 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:30.470512    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:30.471061 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:30.470625    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:30.471061 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:30.470745    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:30.471061 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:30.470809    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:32.470232 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:32.470195    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:32.470701 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:32.470237    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:32.470701 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:32.470303    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:32.470701 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:32.470316    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:32.470701 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:32.470379    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:32.470701 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:32.470484    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:34.235635 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:34.235605    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs\") pod \"network-metrics-daemon-h66wv\" (UID: \"5531f102-84da-411c-99df-840e1f4b871a\") " pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:34.236064 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:34.235652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtsjk\" (UniqueName: \"kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk\") pod \"network-check-target-jljqh\" (UID: \"1f624899-5fbc-4977-94c6-6804349ae457\") " pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:34.236064 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:34.235681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret\") pod \"global-pull-secret-syncer-g285v\" (UID: \"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4\") " pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:34.236064 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:34.235766    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:24:34.236064 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:34.235773    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:24:34.236064 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:34.235833    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs podName:5531f102-84da-411c-99df-840e1f4b871a nodeName:}" failed. No retries permitted until 2026-07-27 17:24:50.235812685 +0000 UTC m=+33.250479123 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs") pod "network-metrics-daemon-h66wv" (UID: "5531f102-84da-411c-99df-840e1f4b871a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:24:34.236064 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:34.235849    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:24:34.236064 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:34.235880    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:24:34.236064 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:34.235896    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xtsjk for pod openshift-network-diagnostics/network-check-target-jljqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:24:34.236064 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:34.235856    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret podName:f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4 nodeName:}" failed. No retries permitted until 2026-07-27 17:24:50.235846411 +0000 UTC m=+33.250512852 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret") pod "global-pull-secret-syncer-g285v" (UID: "f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:24:34.236064 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:34.235954    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk podName:1f624899-5fbc-4977-94c6-6804349ae457 nodeName:}" failed. No retries permitted until 2026-07-27 17:24:50.235942617 +0000 UTC m=+33.250609042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtsjk" (UniqueName: "kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk") pod "network-check-target-jljqh" (UID: "1f624899-5fbc-4977-94c6-6804349ae457") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:24:34.470475 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:34.470437    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:34.470705 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:34.470437    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:34.470705 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:34.470573    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:34.470705 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:34.470604    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:34.470868 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:34.470704    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:34.470868 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:34.470778    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:36.470496 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:36.470464    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:36.470496 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:36.470498    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:36.471043 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:36.470606    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:36.471043 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:36.470604    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:36.471043 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:36.470728    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:36.471043 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:36.470824    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:38.471006 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:38.470964    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:38.471006 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:38.471005    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:38.471524 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:38.471011    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:38.471524 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:38.471095    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:38.471524 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:38.471212    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:38.471524 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:38.471292    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:39.629523 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:39.629154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z926n" event={"ID":"268328d8-17e6-4980-b517-73cd00a35a5d","Type":"ContainerStarted","Data":"f0437793957da7135ba80cc73435b534cc1900938ae3e3db27442bd885826aad"}
Jul 27 17:24:39.630016 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:39.629536    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z926n" event={"ID":"268328d8-17e6-4980-b517-73cd00a35a5d","Type":"ContainerStarted","Data":"afaf90cd29493245c84b8bf60406d429241fae35e423c42db72235792b09ec44"}
Jul 27 17:24:39.631324 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:39.631300    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hjktq" event={"ID":"d1b64542-2d00-4778-b6fa-979fc0acc04d","Type":"ContainerStarted","Data":"f65cc316c5d6ed6172acf479bcb42c41491a5fa9e1cd8a0b0578ad4b0d2cac2a"}
Jul 27 17:24:39.633968 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:39.633945    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal" event={"ID":"0a61dacdec00e617530332f7c59343be","Type":"ContainerStarted","Data":"211ce01280132b875e51dc21340238897a37c4cdc43fa006ad01d530094ec8f2"}
Jul 27 17:24:39.635728 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:39.635698    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z2lls" event={"ID":"06143fc2-1884-4652-b9ba-20b433e4febc","Type":"ContainerStarted","Data":"b2a72de59aed9e02677ab48095a49a49fd21e9b8c4dd634dd977b7133a9a7409"}
Jul 27 17:24:39.650856 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:39.650800    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hjktq" podStartSLOduration=1.233234993 podStartE2EDuration="21.65078249s" totalImagesPullingTime="20.417547497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:24:39.65075919 +0000 UTC m=+22.665425635" watchObservedRunningTime="2026-07-27 17:24:39.65078249 +0000 UTC m=+22.665448934"
Jul 27 17:24:39.664775 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:39.664734    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal" podStartSLOduration=21.664716079 podStartE2EDuration="21.664716079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:24:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:24:39.664349561 +0000 UTC m=+22.679016002" watchObservedRunningTime="2026-07-27 17:24:39.664716079 +0000 UTC m=+22.679382522"
Jul 27 17:24:40.470118 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.470075    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:40.470285 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.470190    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:40.470285 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.470207    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:40.470285 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:40.470201    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:40.470285 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:40.470276    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:40.470419 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:40.470343    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:40.640338 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.640016    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bvhpw" event={"ID":"c363bcd6-1a11-4e08-911a-74e0c07685c1","Type":"ContainerStarted","Data":"602d5feacf9f9bc6b1b0623b1ca76524d8e9d7a71f48f00bb36dacd9e76311ed"}
Jul 27 17:24:40.641760 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.641727    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rwn2d" event={"ID":"ce020319-484a-4868-86f5-4bb9683bac2f","Type":"ContainerStarted","Data":"3500b8565513f262c337241177bf9d54435993ba187afe74da3ca90719dd0175"}
Jul 27 17:24:40.643375 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.643347    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-trb87" event={"ID":"5ac14a62-8827-4d06-a67d-2ac290fb0ae7","Type":"ContainerStarted","Data":"4c67bf19ab584877deace82edff79ec784cb2c3e95ee95419435458e8b31d736"}
Jul 27 17:24:40.645064 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.645035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4" event={"ID":"bb8c0306-b173-4f3c-8764-382e8625a572","Type":"ContainerStarted","Data":"1152c63f684ef5927cedefb2c6da7a6cbccd411753ccc81a8ec508980577196d"}
Jul 27 17:24:40.647034 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.646688    2580 generic.go:356] "Generic (PLEG): container finished" podID="1f96f4a07b9f4100ed7f79cf800b040b" containerID="6ceda86af72fad1300c1f313d04c8e0acc3146f565a465e0658bdfd5795b71f1" exitCode=0
Jul 27 17:24:40.647034 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.646776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" event={"ID":"1f96f4a07b9f4100ed7f79cf800b040b","Type":"ContainerDied","Data":"6ceda86af72fad1300c1f313d04c8e0acc3146f565a465e0658bdfd5795b71f1"}
Jul 27 17:24:40.650284 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.650260    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z926n" event={"ID":"268328d8-17e6-4980-b517-73cd00a35a5d","Type":"ContainerStarted","Data":"f888d86945e227dc0ba7b280263343968c58c75ad2785c0e2f1a7c8587a3cb6c"}
Jul 27 17:24:40.650405 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.650328    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z926n" event={"ID":"268328d8-17e6-4980-b517-73cd00a35a5d","Type":"ContainerStarted","Data":"4ed40dba8a0870bc2f2fb89b0b7874e9a0f8a1e50a0bc386dd168bd801f2aaa2"}
Jul 27 17:24:40.650405 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.650363    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z926n" event={"ID":"268328d8-17e6-4980-b517-73cd00a35a5d","Type":"ContainerStarted","Data":"a752a522c2a6d1b8f5ff6e313d0df09cd342c2188f5cce2252023b426abed212"}
Jul 27 17:24:40.650405 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.650396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z926n" event={"ID":"268328d8-17e6-4980-b517-73cd00a35a5d","Type":"ContainerStarted","Data":"bdd4b4676e30310dc78b9c8922c67a09a0d12d2ea63b70095b4f62b1f9c68185"}
Jul 27 17:24:40.651923 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.651896    2580 generic.go:356] "Generic (PLEG): container finished" podID="b18fd914-4db8-475c-ac98-4d024ab840b3" containerID="01f7938f24636bac5f5b32c996c948f3e906b5c6302c1edcf94f9efccc24e01f" exitCode=0
Jul 27 17:24:40.652042 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.652001    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lr6rh" event={"ID":"b18fd914-4db8-475c-ac98-4d024ab840b3","Type":"ContainerDied","Data":"01f7938f24636bac5f5b32c996c948f3e906b5c6302c1edcf94f9efccc24e01f"}
Jul 27 17:24:40.655198 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.655162    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bvhpw" podStartSLOduration=2.229418557 podStartE2EDuration="22.655150132s" totalImagesPullingTime="20.425731575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:24:40.655003865 +0000 UTC m=+23.669670312" watchObservedRunningTime="2026-07-27 17:24:40.655150132 +0000 UTC m=+23.669816576"
Jul 27 17:24:40.655595 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.655558    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z2lls" podStartSLOduration=2.070531087 podStartE2EDuration="22.655550865s" totalImagesPullingTime="20.585019778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:24:39.70189258 +0000 UTC m=+22.716559023" watchObservedRunningTime="2026-07-27 17:24:40.655550865 +0000 UTC m=+23.670217309"
Jul 27 17:24:40.707909 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.707868    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rwn2d" podStartSLOduration=3.264406119 podStartE2EDuration="23.707852338s" totalImagesPullingTime="20.443446219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:24:40.693893194 +0000 UTC m=+23.708559637" watchObservedRunningTime="2026-07-27 17:24:40.707852338 +0000 UTC m=+23.722518781"
Jul 27 17:24:40.708274 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:40.708252    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-trb87" podStartSLOduration=2.279856725 podStartE2EDuration="22.708244499s" totalImagesPullingTime="20.428387774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:24:40.707647931 +0000 UTC m=+23.722314374" watchObservedRunningTime="2026-07-27 17:24:40.708244499 +0000 UTC m=+23.722910943"
Jul 27 17:24:41.132209 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:41.132182    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 17:24:41.451868 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:41.451790    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bvhpw"
Jul 27 17:24:41.452421 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:41.452394    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bvhpw"
Jul 27 17:24:41.474051 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:41.473968    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T17:24:41.132200261Z","UUID":"949a98a6-376e-46ec-a62b-f6bbe32d1063","Handler":null,"Name":"","Endpoint":""}
Jul 27 17:24:41.475617 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:41.475600    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 17:24:41.475744 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:41.475639    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 17:24:41.656517 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:41.656472    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4" event={"ID":"bb8c0306-b173-4f3c-8764-382e8625a572","Type":"ContainerStarted","Data":"fa3ab4669aa5183d2228c5eb839f51f8b05f1cc7d016e23d280194ab29aeb8bd"}
Jul 27 17:24:41.658910 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:41.658856    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" event={"ID":"1f96f4a07b9f4100ed7f79cf800b040b","Type":"ContainerStarted","Data":"6d042743fce3be1a8ab7fab2034557fcef3a834d9b801f5236d341e44b78c0c7"}
Jul 27 17:24:41.661119 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:41.661091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n9mjw" event={"ID":"0298f962-c37b-4373-b625-3e715ad20b6a","Type":"ContainerStarted","Data":"d17030593627b56084dbfc46d76e7acb57d92f66a29869207fcca6ec3397f56f"}
Jul 27 17:24:41.661710 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:41.661690    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bvhpw"
Jul 27 17:24:41.662191 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:41.662174    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bvhpw"
Jul 27 17:24:41.689521 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:41.689468    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" podStartSLOduration=23.689451882 podStartE2EDuration="23.689451882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:24:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:24:41.674524088 +0000 UTC m=+24.689190534" watchObservedRunningTime="2026-07-27 17:24:41.689451882 +0000 UTC m=+24.704118332"
Jul 27 17:24:41.689992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:41.689962    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n9mjw" podStartSLOduration=3.372214967 podStartE2EDuration="23.689951256s" totalImagesPullingTime="20.317736289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:24:41.689431951 +0000 UTC m=+24.704098396" watchObservedRunningTime="2026-07-27 17:24:41.689951256 +0000 UTC m=+24.704617700"
Jul 27 17:24:42.470226 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:42.470194    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:42.470431 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:42.470233    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:42.470431 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:42.470333    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:42.470431 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:42.470340    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:42.470431 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:42.470410    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:42.470575 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:42.470488    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:42.666210 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:42.666172    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4" event={"ID":"bb8c0306-b173-4f3c-8764-382e8625a572","Type":"ContainerStarted","Data":"d10f68332ea601e1f41a90cba739ef979119f38f71bb86de81c53f75b444970c"}
Jul 27 17:24:42.670169 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:42.670131    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z926n" event={"ID":"268328d8-17e6-4980-b517-73cd00a35a5d","Type":"ContainerStarted","Data":"deebdabf26401b4afae571f90a33309628677965958caa24ceb796b284f0d694"}
Jul 27 17:24:42.684638 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:42.684575    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-htwb4" podStartSLOduration=2.99567344 podStartE2EDuration="25.684558393s" totalImagesPullingTime="22.688884953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:24:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:24:42.684144559 +0000 UTC m=+25.698811006" watchObservedRunningTime="2026-07-27 17:24:42.684558393 +0000 UTC m=+25.699224839"
Jul 27 17:24:44.470897 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:44.470859    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:44.470897 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:44.470885    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:44.471430 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:44.470871    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:44.471430 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:44.471005    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:44.471430 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:44.471101    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:44.471430 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:44.471196    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:45.680015 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:45.679755    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z926n" event={"ID":"268328d8-17e6-4980-b517-73cd00a35a5d","Type":"ContainerStarted","Data":"db26d5dc4031000138fa14df503001720075fa08b4dc7e66888396f7d5f0fd7a"}
Jul 27 17:24:45.680903 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:45.680082    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:45.680903 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:45.680129    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:45.681630 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:45.681599    2580 generic.go:356] "Generic (PLEG): container finished" podID="b18fd914-4db8-475c-ac98-4d024ab840b3" containerID="456858b64681715c47c7b2fcebb17abd3da0f5165813c07d036035a12d57e9a3" exitCode=0
Jul 27 17:24:45.681770 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:45.681654    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lr6rh" event={"ID":"b18fd914-4db8-475c-ac98-4d024ab840b3","Type":"ContainerDied","Data":"456858b64681715c47c7b2fcebb17abd3da0f5165813c07d036035a12d57e9a3"}
Jul 27 17:24:45.695378 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:45.695359    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:45.708285 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:45.708248    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z926n" podStartSLOduration=7.297971657 podStartE2EDuration="27.708235603s" totalImagesPullingTime="20.410263946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:24:45.707843917 +0000 UTC m=+28.722510361" watchObservedRunningTime="2026-07-27 17:24:45.708235603 +0000 UTC m=+28.722902047"
Jul 27 17:24:46.470767 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:46.470561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:46.471052 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:46.470571    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:46.471052 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:46.470830    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:46.471052 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:46.470649    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:46.471052 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:46.470904    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:46.471052 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:46.470979    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:46.685095 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:46.685002    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:46.704924 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:46.704896    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:24:47.006340 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:47.006310    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h66wv"]
Jul 27 17:24:47.006526 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:47.006434    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:47.006605 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:47.006556    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:47.009616 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:47.009561    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jljqh"]
Jul 27 17:24:47.009947 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:47.009683    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:47.009947 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:47.009787    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:47.010303 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:47.010271    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g285v"]
Jul 27 17:24:47.010394 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:47.010370    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:47.010495 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:47.010468    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:47.688271 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:47.688237    2580 generic.go:356] "Generic (PLEG): container finished" podID="b18fd914-4db8-475c-ac98-4d024ab840b3" containerID="9c5a0514c1f34707b6d20eb964ba1261e624970c32b3db6b135941eb238cd0be" exitCode=0
Jul 27 17:24:47.688686 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:47.688317    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lr6rh" event={"ID":"b18fd914-4db8-475c-ac98-4d024ab840b3","Type":"ContainerDied","Data":"9c5a0514c1f34707b6d20eb964ba1261e624970c32b3db6b135941eb238cd0be"}
Jul 27 17:24:48.470355 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:48.470331    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:48.470480 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:48.470330    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:48.470480 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:48.470428    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:48.470566 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:48.470331    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:48.470566 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:48.470508    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:48.470663 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:48.470612    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:50.257069 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:50.257040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs\") pod \"network-metrics-daemon-h66wv\" (UID: \"5531f102-84da-411c-99df-840e1f4b871a\") " pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:50.257472 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:50.257081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtsjk\" (UniqueName: \"kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk\") pod \"network-check-target-jljqh\" (UID: \"1f624899-5fbc-4977-94c6-6804349ae457\") " pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:50.257472 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:50.257099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret\") pod \"global-pull-secret-syncer-g285v\" (UID: \"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4\") " pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:50.257472 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:50.257184    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:24:50.257472 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:50.257186    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:24:50.257472 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:50.257201    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:24:50.257472 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:50.257224    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:24:50.257472 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:50.257234    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret podName:f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:22.257220861 +0000 UTC m=+65.271887296 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret") pod "global-pull-secret-syncer-g285v" (UID: "f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:24:50.257472 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:50.257237    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xtsjk for pod openshift-network-diagnostics/network-check-target-jljqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:24:50.257472 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:50.257248    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs podName:5531f102-84da-411c-99df-840e1f4b871a nodeName:}" failed. No retries permitted until 2026-07-27 17:25:22.257241556 +0000 UTC m=+65.271907979 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs") pod "network-metrics-daemon-h66wv" (UID: "5531f102-84da-411c-99df-840e1f4b871a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:24:50.257472 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:50.257277    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk podName:1f624899-5fbc-4977-94c6-6804349ae457 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:22.257263697 +0000 UTC m=+65.271930123 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtsjk" (UniqueName: "kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk") pod "network-check-target-jljqh" (UID: "1f624899-5fbc-4977-94c6-6804349ae457") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:24:50.470198 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:50.470170    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:50.470359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:50.470202    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:50.470359 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:50.470286    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jljqh" podUID="1f624899-5fbc-4977-94c6-6804349ae457"
Jul 27 17:24:50.470475 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:50.470372    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:24:50.470475 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:50.470401    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:50.470475 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:50.470463    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g285v" podUID="f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4"
Jul 27 17:24:50.700196 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:50.700157    2580 generic.go:356] "Generic (PLEG): container finished" podID="b18fd914-4db8-475c-ac98-4d024ab840b3" containerID="3e625831affe3f556c5c8167d3a00345d4fe50d81fc12abc3f71b97d263b3d5e" exitCode=0
Jul 27 17:24:50.700409 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:50.700214    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lr6rh" event={"ID":"b18fd914-4db8-475c-ac98-4d024ab840b3","Type":"ContainerDied","Data":"3e625831affe3f556c5c8167d3a00345d4fe50d81fc12abc3f71b97d263b3d5e"}
Jul 27 17:24:52.312176 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.311975    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeReady"
Jul 27 17:24:52.312631 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.312308    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 17:24:52.348251 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.348219    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"]
Jul 27 17:24:52.371411 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.371384    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-778d9f886b-nqgxt"]
Jul 27 17:24:52.371567 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.371530    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:24:52.374149 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.374123    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 27 17:24:52.374288 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.374182    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 27 17:24:52.374485 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.374467    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mgql4\""
Jul 27 17:24:52.387531 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.387508    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"]
Jul 27 17:24:52.387676 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.387615    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-677g9"]
Jul 27 17:24:52.387676 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.387635    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.390998 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.390499    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 17:24:52.390998 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.390530    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 17:24:52.390998 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.390651    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 17:24:52.390998 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.390810    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-krvhz\""
Jul 27 17:24:52.398747 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.398720    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 17:24:52.404375 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.404353    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-778d9f886b-nqgxt"]
Jul 27 17:24:52.404476 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.404393    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z7f45"]
Jul 27 17:24:52.404906 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.404618    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-677g9"
Jul 27 17:24:52.407033 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.407012    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 17:24:52.407142 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.407087    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wkb8l\""
Jul 27 17:24:52.407142 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.407117    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 17:24:52.407402 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.407383    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 17:24:52.418807 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.418783    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-677g9"]
Jul 27 17:24:52.418901 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.418821    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z7f45"]
Jul 27 17:24:52.418949 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.418929    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7f45"
Jul 27 17:24:52.421452 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.421431    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 17:24:52.421539 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.421487    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 17:24:52.421539 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.421436    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pwzz8\""
Jul 27 17:24:52.470193 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.470161    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:24:52.470324 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.470273    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:24:52.470324 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.470295    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:24:52.473045 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.473024    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 17:24:52.473274 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.473254    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 17:24:52.473570 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.473553    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jcmcw\""
Jul 27 17:24:52.473668 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.473634    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 17:24:52.473668 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.473642    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 17:24:52.473668 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.473641    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6qpqw\""
Jul 27 17:24:52.474739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.474717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-image-registry-private-configuration\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.474853 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.474759    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-certificates\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.474853 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.474816    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-installation-pull-secrets\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.474966 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.474853    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4749\" (UniqueName: \"kubernetes.io/projected/e66a5198-bfde-4dc9-9bab-0b58f4e80b37-kube-api-access-q4749\") pod \"ingress-canary-677g9\" (UID: \"e66a5198-bfde-4dc9-9bab-0b58f4e80b37\") " pod="openshift-ingress-canary/ingress-canary-677g9"
Jul 27 17:24:52.474966 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.474882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-ca-trust-extracted\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.474966 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.474917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e66a5198-bfde-4dc9-9bab-0b58f4e80b37-cert\") pod \"ingress-canary-677g9\" (UID: \"e66a5198-bfde-4dc9-9bab-0b58f4e80b37\") " pod="openshift-ingress-canary/ingress-canary-677g9"
Jul 27 17:24:52.474966 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.474940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77db0526-9ce6-4899-9e8c-07448e529a34-config-volume\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:24:52.475135 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.474978    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/97944373-5fc9-4556-aac0-33c5aba5436c-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-bqcbv\" (UID: \"97944373-5fc9-4556-aac0-33c5aba5436c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:24:52.475135 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.475010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-bound-sa-token\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.475135 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.475107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bqcbv\" (UID: \"97944373-5fc9-4556-aac0-33c5aba5436c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:24:52.475135 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.475130    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.475280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.475164    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:24:52.475280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.475180    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-trusted-ca\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.475280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.475196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77db0526-9ce6-4899-9e8c-07448e529a34-tmp-dir\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:24:52.475280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.475211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqtqp\" (UniqueName: \"kubernetes.io/projected/77db0526-9ce6-4899-9e8c-07448e529a34-kube-api-access-bqtqp\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:24:52.475280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.475244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfqtd\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-kube-api-access-pfqtd\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.576341 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576257    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-image-registry-private-configuration\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.576341 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-certificates\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.576567 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576377    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-installation-pull-secrets\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.576567 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4749\" (UniqueName: \"kubernetes.io/projected/e66a5198-bfde-4dc9-9bab-0b58f4e80b37-kube-api-access-q4749\") pod \"ingress-canary-677g9\" (UID: \"e66a5198-bfde-4dc9-9bab-0b58f4e80b37\") " pod="openshift-ingress-canary/ingress-canary-677g9"
Jul 27 17:24:52.576567 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576439    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-ca-trust-extracted\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.576567 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576467    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e66a5198-bfde-4dc9-9bab-0b58f4e80b37-cert\") pod \"ingress-canary-677g9\" (UID: \"e66a5198-bfde-4dc9-9bab-0b58f4e80b37\") " pod="openshift-ingress-canary/ingress-canary-677g9"
Jul 27 17:24:52.576567 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576492    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77db0526-9ce6-4899-9e8c-07448e529a34-config-volume\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:24:52.576567 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/97944373-5fc9-4556-aac0-33c5aba5436c-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-bqcbv\" (UID: \"97944373-5fc9-4556-aac0-33c5aba5436c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:24:52.576567 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576566    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-bound-sa-token\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.577013 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576625    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bqcbv\" (UID: \"97944373-5fc9-4556-aac0-33c5aba5436c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:24:52.577013 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.577013 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:24:52.577013 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-trusted-ca\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.577013 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77db0526-9ce6-4899-9e8c-07448e529a34-tmp-dir\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:24:52.577013 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqtqp\" (UniqueName: \"kubernetes.io/projected/77db0526-9ce6-4899-9e8c-07448e529a34-kube-api-access-bqtqp\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:24:52.577013 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576957    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfqtd\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-kube-api-access-pfqtd\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.577013 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.576963    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-ca-trust-extracted\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.577410 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:52.577072    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:24:52.577410 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:52.577169    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 17:24:52.577410 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.577211    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-certificates\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.577410 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:52.577243    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert podName:97944373-5fc9-4556-aac0-33c5aba5436c nodeName:}" failed. No retries permitted until 2026-07-27 17:24:53.077221367 +0000 UTC m=+36.091887816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-bqcbv" (UID: "97944373-5fc9-4556-aac0-33c5aba5436c") : secret "networking-console-plugin-cert" not found
Jul 27 17:24:52.577410 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:52.577266    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls podName:77db0526-9ce6-4899-9e8c-07448e529a34 nodeName:}" failed. No retries permitted until 2026-07-27 17:24:53.077254573 +0000 UTC m=+36.091921006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls") pod "dns-default-z7f45" (UID: "77db0526-9ce6-4899-9e8c-07448e529a34") : secret "dns-default-metrics-tls" not found
Jul 27 17:24:52.577410 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:52.577378    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:24:52.577410 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:52.577392    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-778d9f886b-nqgxt: secret "image-registry-tls" not found
Jul 27 17:24:52.577410 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.577408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77db0526-9ce6-4899-9e8c-07448e529a34-tmp-dir\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:24:52.577827 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:52.577436    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls podName:ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f nodeName:}" failed. No retries permitted until 2026-07-27 17:24:53.077419527 +0000 UTC m=+36.092085966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls") pod "image-registry-778d9f886b-nqgxt" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f") : secret "image-registry-tls" not found
Jul 27 17:24:52.577827 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.577455    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/97944373-5fc9-4556-aac0-33c5aba5436c-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-bqcbv\" (UID: \"97944373-5fc9-4556-aac0-33c5aba5436c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:24:52.577827 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.577677    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77db0526-9ce6-4899-9e8c-07448e529a34-config-volume\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:24:52.578261 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.578237    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-trusted-ca\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.581574 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.581553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e66a5198-bfde-4dc9-9bab-0b58f4e80b37-cert\") pod \"ingress-canary-677g9\" (UID: \"e66a5198-bfde-4dc9-9bab-0b58f4e80b37\") " pod="openshift-ingress-canary/ingress-canary-677g9"
Jul 27 17:24:52.581702 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.581662    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-image-registry-private-configuration\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.581829 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.581805    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-installation-pull-secrets\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.586450 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.586426    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-bound-sa-token\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.586669 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.586645    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqtqp\" (UniqueName: \"kubernetes.io/projected/77db0526-9ce6-4899-9e8c-07448e529a34-kube-api-access-bqtqp\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:24:52.586835 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.586792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfqtd\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-kube-api-access-pfqtd\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:52.587156 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.587135    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4749\" (UniqueName: \"kubernetes.io/projected/e66a5198-bfde-4dc9-9bab-0b58f4e80b37-kube-api-access-q4749\") pod \"ingress-canary-677g9\" (UID: \"e66a5198-bfde-4dc9-9bab-0b58f4e80b37\") " pod="openshift-ingress-canary/ingress-canary-677g9"
Jul 27 17:24:52.714508 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.714479    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-677g9"
Jul 27 17:24:52.943999 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:52.943964    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-677g9"]
Jul 27 17:24:52.948619 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:24:52.948570    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode66a5198_bfde_4dc9_9bab_0b58f4e80b37.slice/crio-f40a4d0e92ad1d69f54e58a939789da3621884dc2a69c95c757dd0fdda2b4f2e WatchSource:0}: Error finding container f40a4d0e92ad1d69f54e58a939789da3621884dc2a69c95c757dd0fdda2b4f2e: Status 404 returned error can't find the container with id f40a4d0e92ad1d69f54e58a939789da3621884dc2a69c95c757dd0fdda2b4f2e
Jul 27 17:24:53.081679 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:53.081639    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:53.081859 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:53.081687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:24:53.081859 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:53.081773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bqcbv\" (UID: \"97944373-5fc9-4556-aac0-33c5aba5436c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:24:53.081859 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:53.081816    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:24:53.081859 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:53.081839    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-778d9f886b-nqgxt: secret "image-registry-tls" not found
Jul 27 17:24:53.082068 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:53.081875    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 17:24:53.082068 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:53.081878    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:24:53.082068 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:53.081908    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls podName:ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f nodeName:}" failed. No retries permitted until 2026-07-27 17:24:54.081886222 +0000 UTC m=+37.096552663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls") pod "image-registry-778d9f886b-nqgxt" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f") : secret "image-registry-tls" not found
Jul 27 17:24:53.082068 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:53.081927    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert podName:97944373-5fc9-4556-aac0-33c5aba5436c nodeName:}" failed. No retries permitted until 2026-07-27 17:24:54.081917872 +0000 UTC m=+37.096584312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-bqcbv" (UID: "97944373-5fc9-4556-aac0-33c5aba5436c") : secret "networking-console-plugin-cert" not found
Jul 27 17:24:53.082068 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:53.081943    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls podName:77db0526-9ce6-4899-9e8c-07448e529a34 nodeName:}" failed. No retries permitted until 2026-07-27 17:24:54.081936055 +0000 UTC m=+37.096602501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls") pod "dns-default-z7f45" (UID: "77db0526-9ce6-4899-9e8c-07448e529a34") : secret "dns-default-metrics-tls" not found
Jul 27 17:24:53.710328 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:53.710288    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-677g9" event={"ID":"e66a5198-bfde-4dc9-9bab-0b58f4e80b37","Type":"ContainerStarted","Data":"f40a4d0e92ad1d69f54e58a939789da3621884dc2a69c95c757dd0fdda2b4f2e"}
Jul 27 17:24:54.091031 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:54.090769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bqcbv\" (UID: \"97944373-5fc9-4556-aac0-33c5aba5436c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:24:54.091031 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:54.090998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:54.091231 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:54.091035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:24:54.091231 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:54.090933    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 17:24:54.091231 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:54.091128    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert podName:97944373-5fc9-4556-aac0-33c5aba5436c nodeName:}" failed. No retries permitted until 2026-07-27 17:24:56.09111071 +0000 UTC m=+39.105777154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-bqcbv" (UID: "97944373-5fc9-4556-aac0-33c5aba5436c") : secret "networking-console-plugin-cert" not found
Jul 27 17:24:54.091231 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:54.091172    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:24:54.091231 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:54.091181    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:24:54.091231 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:54.091201    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-778d9f886b-nqgxt: secret "image-registry-tls" not found
Jul 27 17:24:54.091231 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:54.091218    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls podName:77db0526-9ce6-4899-9e8c-07448e529a34 nodeName:}" failed. No retries permitted until 2026-07-27 17:24:56.09120634 +0000 UTC m=+39.105872761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls") pod "dns-default-z7f45" (UID: "77db0526-9ce6-4899-9e8c-07448e529a34") : secret "dns-default-metrics-tls" not found
Jul 27 17:24:54.091499 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:54.091246    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls podName:ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f nodeName:}" failed. No retries permitted until 2026-07-27 17:24:56.091231207 +0000 UTC m=+39.105897643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls") pod "image-registry-778d9f886b-nqgxt" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f") : secret "image-registry-tls" not found
Jul 27 17:24:55.718974 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:55.718933    2580 generic.go:356] "Generic (PLEG): container finished" podID="b18fd914-4db8-475c-ac98-4d024ab840b3" containerID="b878a73bf2920d04b340e8e51263b7d447b5ba5a2ae2b788b4490d21a5739484" exitCode=0
Jul 27 17:24:55.719367 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:55.718998    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lr6rh" event={"ID":"b18fd914-4db8-475c-ac98-4d024ab840b3","Type":"ContainerDied","Data":"b878a73bf2920d04b340e8e51263b7d447b5ba5a2ae2b788b4490d21a5739484"}
Jul 27 17:24:56.108869 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:56.108786    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bqcbv\" (UID: \"97944373-5fc9-4556-aac0-33c5aba5436c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:24:56.108869 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:56.108826    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:24:56.108869 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:56.108845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:24:56.109071 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:56.108943    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 17:24:56.109071 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:56.108980    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:24:56.109071 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:56.109008    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert podName:97944373-5fc9-4556-aac0-33c5aba5436c nodeName:}" failed. No retries permitted until 2026-07-27 17:25:00.108991542 +0000 UTC m=+43.123657983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-bqcbv" (UID: "97944373-5fc9-4556-aac0-33c5aba5436c") : secret "networking-console-plugin-cert" not found
Jul 27 17:24:56.109071 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:56.108944    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:24:56.109071 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:56.109034    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-778d9f886b-nqgxt: secret "image-registry-tls" not found
Jul 27 17:24:56.109071 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:56.109048    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls podName:77db0526-9ce6-4899-9e8c-07448e529a34 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:00.109023543 +0000 UTC m=+43.123689984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls") pod "dns-default-z7f45" (UID: "77db0526-9ce6-4899-9e8c-07448e529a34") : secret "dns-default-metrics-tls" not found
Jul 27 17:24:56.109254 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:24:56.109077    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls podName:ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f nodeName:}" failed. No retries permitted until 2026-07-27 17:25:00.109067144 +0000 UTC m=+43.123733581 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls") pod "image-registry-778d9f886b-nqgxt" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f") : secret "image-registry-tls" not found
Jul 27 17:24:56.260702 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:56.260652    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:24:56.347919 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:56.347882    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:24:56.416562 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:56.416481    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:24:56.724950 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:56.724875    2580 generic.go:356] "Generic (PLEG): container finished" podID="b18fd914-4db8-475c-ac98-4d024ab840b3" containerID="a79882126d6a175116fe841dc512b75e61dc269ea9ed7929ada283fe9dab6371" exitCode=0
Jul 27 17:24:56.724950 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:56.724934    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lr6rh" event={"ID":"b18fd914-4db8-475c-ac98-4d024ab840b3","Type":"ContainerDied","Data":"a79882126d6a175116fe841dc512b75e61dc269ea9ed7929ada283fe9dab6371"}
Jul 27 17:24:57.720618 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:57.720423    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:24:57.730616 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:57.730574    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lr6rh" event={"ID":"b18fd914-4db8-475c-ac98-4d024ab840b3","Type":"ContainerStarted","Data":"25c8d9fad83af12488ca038563db423b38658204bf7110e401a6863983c774df"}
Jul 27 17:24:57.731927 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:57.731901    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-677g9" event={"ID":"e66a5198-bfde-4dc9-9bab-0b58f4e80b37","Type":"ContainerStarted","Data":"0a858790602159518f7cd5248ec953e4423e11ca40c46cbb3cce2166e6827e99"}
Jul 27 17:24:57.755322 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:57.755279    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lr6rh" podStartSLOduration=6.590800316 podStartE2EDuration="39.755244948s" totalImagesPullingTime="33.164444632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:24:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:24:57.754094494 +0000 UTC m=+40.768760939" watchObservedRunningTime="2026-07-27 17:24:57.755244948 +0000 UTC m=+40.769911407"
Jul 27 17:24:57.769693 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:57.769657    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-677g9" podStartSLOduration=1.400142354 podStartE2EDuration="5.769644258s" totalImagesPullingTime="4.369501904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:24:57.768939572 +0000 UTC m=+40.783606018" watchObservedRunningTime="2026-07-27 17:24:57.769644258 +0000 UTC m=+40.784310680"
Jul 27 17:24:57.858340 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:57.858303    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:24:57.916052 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:24:57.916016    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:00.142919 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.142876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bqcbv\" (UID: \"97944373-5fc9-4556-aac0-33c5aba5436c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:25:00.142919 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.142923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:25:00.143330 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.142948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:25:00.143330 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:00.143045    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 17:25:00.143330 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:00.143107    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert podName:97944373-5fc9-4556-aac0-33c5aba5436c nodeName:}" failed. No retries permitted until 2026-07-27 17:25:08.143092473 +0000 UTC m=+51.157758909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-bqcbv" (UID: "97944373-5fc9-4556-aac0-33c5aba5436c") : secret "networking-console-plugin-cert" not found
Jul 27 17:25:00.143330 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:00.143114    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:25:00.143330 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:00.143048    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:25:00.143330 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:00.143142    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-778d9f886b-nqgxt: secret "image-registry-tls" not found
Jul 27 17:25:00.143330 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:00.143184    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls podName:77db0526-9ce6-4899-9e8c-07448e529a34 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:08.143168472 +0000 UTC m=+51.157834915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls") pod "dns-default-z7f45" (UID: "77db0526-9ce6-4899-9e8c-07448e529a34") : secret "dns-default-metrics-tls" not found
Jul 27 17:25:00.143330 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:00.143198    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls podName:ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f nodeName:}" failed. No retries permitted until 2026-07-27 17:25:08.14319268 +0000 UTC m=+51.157859101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls") pod "image-registry-778d9f886b-nqgxt" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f") : secret "image-registry-tls" not found
Jul 27 17:25:00.753776 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.753743    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd"]
Jul 27 17:25:00.787102 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.787072    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"]
Jul 27 17:25:00.787260 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.787191    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd"
Jul 27 17:25:00.790266 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.790246    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-m4jxf\""
Jul 27 17:25:00.791236 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.791213    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 17:25:00.791336 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.791259    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 17:25:00.791336 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.791269    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 27 17:25:00.791463 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.791335    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 17:25:00.801218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.801198    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd"]
Jul 27 17:25:00.801296 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.801229    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"]
Jul 27 17:25:00.801296 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.801249    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"]
Jul 27 17:25:00.801385 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.801315    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:25:00.803864 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.803846    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 27 17:25:00.823365 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.823346    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"]
Jul 27 17:25:00.823448 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.823435    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:00.825957 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.825937    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 27 17:25:00.826076 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.825966    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 27 17:25:00.826076 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.825985    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 27 17:25:00.826076 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.826042    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 27 17:25:00.947959 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.947917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fd727c1f-86ff-42be-982e-009e780bc9e8-klusterlet-config\") pod \"klusterlet-addon-workmgr-585f4457b9-s6wnf\" (UID: \"fd727c1f-86ff-42be-982e-009e780bc9e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:25:00.947959 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.947958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:00.948206 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.947981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd727c1f-86ff-42be-982e-009e780bc9e8-tmp\") pod \"klusterlet-addon-workmgr-585f4457b9-s6wnf\" (UID: \"fd727c1f-86ff-42be-982e-009e780bc9e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:25:00.948206 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.948012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xczn7\" (UniqueName: \"kubernetes.io/projected/12e2a527-997c-4862-ad29-6862cc830694-kube-api-access-xczn7\") pod \"managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd\" (UID: \"12e2a527-997c-4862-ad29-6862cc830694\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd"
Jul 27 17:25:00.948206 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.948029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-ca\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:00.948206 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.948062    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc8kb\" (UniqueName: \"kubernetes.io/projected/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-kube-api-access-fc8kb\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:00.948206 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.948078    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-hub\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:00.948206 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.948196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:00.948421 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.948240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12e2a527-997c-4862-ad29-6862cc830694-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd\" (UID: \"12e2a527-997c-4862-ad29-6862cc830694\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd"
Jul 27 17:25:00.948421 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.948276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zmsm\" (UniqueName: \"kubernetes.io/projected/fd727c1f-86ff-42be-982e-009e780bc9e8-kube-api-access-4zmsm\") pod \"klusterlet-addon-workmgr-585f4457b9-s6wnf\" (UID: \"fd727c1f-86ff-42be-982e-009e780bc9e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:25:00.948421 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:00.948298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:01.049361 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.049275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:01.049361 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.049314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12e2a527-997c-4862-ad29-6862cc830694-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd\" (UID: \"12e2a527-997c-4862-ad29-6862cc830694\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd"
Jul 27 17:25:01.049361 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.049336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zmsm\" (UniqueName: \"kubernetes.io/projected/fd727c1f-86ff-42be-982e-009e780bc9e8-kube-api-access-4zmsm\") pod \"klusterlet-addon-workmgr-585f4457b9-s6wnf\" (UID: \"fd727c1f-86ff-42be-982e-009e780bc9e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:25:01.049361 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.049353    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:01.049693 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.049527    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fd727c1f-86ff-42be-982e-009e780bc9e8-klusterlet-config\") pod \"klusterlet-addon-workmgr-585f4457b9-s6wnf\" (UID: \"fd727c1f-86ff-42be-982e-009e780bc9e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:25:01.049693 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.049567    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:01.049693 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.049626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd727c1f-86ff-42be-982e-009e780bc9e8-tmp\") pod \"klusterlet-addon-workmgr-585f4457b9-s6wnf\" (UID: \"fd727c1f-86ff-42be-982e-009e780bc9e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:25:01.049693 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.049666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xczn7\" (UniqueName: \"kubernetes.io/projected/12e2a527-997c-4862-ad29-6862cc830694-kube-api-access-xczn7\") pod \"managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd\" (UID: \"12e2a527-997c-4862-ad29-6862cc830694\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd"
Jul 27 17:25:01.049693 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.049689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-ca\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:01.050061 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.050028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc8kb\" (UniqueName: \"kubernetes.io/projected/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-kube-api-access-fc8kb\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:01.050154 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.050083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-hub\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:01.050304 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.050274    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd727c1f-86ff-42be-982e-009e780bc9e8-tmp\") pod \"klusterlet-addon-workmgr-585f4457b9-s6wnf\" (UID: \"fd727c1f-86ff-42be-982e-009e780bc9e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:25:01.050366 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.050323    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:01.053843 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.053813    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:01.053843 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.053829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-hub\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:01.053956 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.053871    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fd727c1f-86ff-42be-982e-009e780bc9e8-klusterlet-config\") pod \"klusterlet-addon-workmgr-585f4457b9-s6wnf\" (UID: \"fd727c1f-86ff-42be-982e-009e780bc9e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:25:01.053956 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.053879    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-ca\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:01.054025 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.053996    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12e2a527-997c-4862-ad29-6862cc830694-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd\" (UID: \"12e2a527-997c-4862-ad29-6862cc830694\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd"
Jul 27 17:25:01.054081 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.054066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:01.057362 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.057336    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc8kb\" (UniqueName: \"kubernetes.io/projected/e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe-kube-api-access-fc8kb\") pod \"cluster-proxy-proxy-agent-6785dd95d-vmdf7\" (UID: \"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:01.057436 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.057414    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xczn7\" (UniqueName: \"kubernetes.io/projected/12e2a527-997c-4862-ad29-6862cc830694-kube-api-access-xczn7\") pod \"managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd\" (UID: \"12e2a527-997c-4862-ad29-6862cc830694\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd"
Jul 27 17:25:01.057815 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.057792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zmsm\" (UniqueName: \"kubernetes.io/projected/fd727c1f-86ff-42be-982e-009e780bc9e8-kube-api-access-4zmsm\") pod \"klusterlet-addon-workmgr-585f4457b9-s6wnf\" (UID: \"fd727c1f-86ff-42be-982e-009e780bc9e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:25:01.107056 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.107025    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd"
Jul 27 17:25:01.114193 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.114167    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:25:01.131479 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.131450    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:25:01.286523 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.286486    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd"]
Jul 27 17:25:01.290079 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:25:01.289515    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12e2a527_997c_4862_ad29_6862cc830694.slice/crio-7944d01078abe9056fa1facfadeaa107016cc8c4b1c2ed95323b549a0d1c17cf WatchSource:0}: Error finding container 7944d01078abe9056fa1facfadeaa107016cc8c4b1c2ed95323b549a0d1c17cf: Status 404 returned error can't find the container with id 7944d01078abe9056fa1facfadeaa107016cc8c4b1c2ed95323b549a0d1c17cf
Jul 27 17:25:01.317665 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.317601    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"]
Jul 27 17:25:01.320538 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:25:01.320514    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd727c1f_86ff_42be_982e_009e780bc9e8.slice/crio-5a399baaba017549b3f76712c8177e5dede678c9b437233f798ea5e4a13fe81d WatchSource:0}: Error finding container 5a399baaba017549b3f76712c8177e5dede678c9b437233f798ea5e4a13fe81d: Status 404 returned error can't find the container with id 5a399baaba017549b3f76712c8177e5dede678c9b437233f798ea5e4a13fe81d
Jul 27 17:25:01.338125 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.338100    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"]
Jul 27 17:25:01.341629 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:25:01.341604    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4ec7ec0_8696_482a_ae3a_3e8cb3d47afe.slice/crio-6dcb568b010fbb1a08d9456ad17ebb7407fb9f194a9db957ad3cfc3ef027fb7d WatchSource:0}: Error finding container 6dcb568b010fbb1a08d9456ad17ebb7407fb9f194a9db957ad3cfc3ef027fb7d: Status 404 returned error can't find the container with id 6dcb568b010fbb1a08d9456ad17ebb7407fb9f194a9db957ad3cfc3ef027fb7d
Jul 27 17:25:01.741533 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.741498    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf" event={"ID":"fd727c1f-86ff-42be-982e-009e780bc9e8","Type":"ContainerStarted","Data":"5a399baaba017549b3f76712c8177e5dede678c9b437233f798ea5e4a13fe81d"}
Jul 27 17:25:01.742517 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.742495    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7" event={"ID":"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe","Type":"ContainerStarted","Data":"6dcb568b010fbb1a08d9456ad17ebb7407fb9f194a9db957ad3cfc3ef027fb7d"}
Jul 27 17:25:01.743528 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:01.743505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd" event={"ID":"12e2a527-997c-4862-ad29-6862cc830694","Type":"ContainerStarted","Data":"7944d01078abe9056fa1facfadeaa107016cc8c4b1c2ed95323b549a0d1c17cf"}
Jul 27 17:25:04.169707 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:04.169603    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:04.270248 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:04.270211    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:04.370646 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:04.370498    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:04.452819 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:04.452732    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:04.519950 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:04.519915    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:04.620646 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:04.620607    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:05.278234 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:05.278202    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:05.378244 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:05.378207    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:05.618790 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:05.618687    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:05.720316 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:05.720283    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:05.816564 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:05.816525    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:06.477046 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:06.477014    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:06.536433 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:06.536395    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:06.879486 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:06.879400    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:06.935008 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:06.934970    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:08.213519 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:08.213449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:25:08.213519 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:08.213503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:25:08.214002 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:08.213604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bqcbv\" (UID: \"97944373-5fc9-4556-aac0-33c5aba5436c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:25:08.214002 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:08.213611    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:25:08.214002 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:08.213635    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-778d9f886b-nqgxt: secret "image-registry-tls" not found
Jul 27 17:25:08.214002 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:08.213675    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:25:08.214002 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:08.213700    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls podName:ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f nodeName:}" failed. No retries permitted until 2026-07-27 17:25:24.213679395 +0000 UTC m=+67.228345829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls") pod "image-registry-778d9f886b-nqgxt" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f") : secret "image-registry-tls" not found
Jul 27 17:25:08.214002 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:08.213708    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 17:25:08.214002 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:08.213762    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls podName:77db0526-9ce6-4899-9e8c-07448e529a34 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:24.213742617 +0000 UTC m=+67.228409056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls") pod "dns-default-z7f45" (UID: "77db0526-9ce6-4899-9e8c-07448e529a34") : secret "dns-default-metrics-tls" not found
Jul 27 17:25:08.214002 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:08.213785    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert podName:97944373-5fc9-4556-aac0-33c5aba5436c nodeName:}" failed. No retries permitted until 2026-07-27 17:25:24.213773818 +0000 UTC m=+67.228440243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-bqcbv" (UID: "97944373-5fc9-4556-aac0-33c5aba5436c") : secret "networking-console-plugin-cert" not found
Jul 27 17:25:08.767278 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:08.767222    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7" event={"ID":"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe","Type":"ContainerStarted","Data":"de5f127905482ec710530eb089c780c77d4e7c0cb5c1b28a52c163b1f6047a06"}
Jul 27 17:25:08.767491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:08.767289    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7" event={"ID":"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe","Type":"ContainerStarted","Data":"569a424839b6613f5e10bb19176253fe859c6cd9fa1c2a2eef9c0e3475c0b5ec"}
Jul 27 17:25:08.767491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:08.767307    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7" event={"ID":"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe","Type":"ContainerStarted","Data":"fd86ae0281d76f6d6f5548b5587e9beba0890460ecadbfd027f50d205f9f8a99"}
Jul 27 17:25:08.768635 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:08.768601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd" event={"ID":"12e2a527-997c-4862-ad29-6862cc830694","Type":"ContainerStarted","Data":"3c518cb14d3791a7bf92f98bd381fcda528ef0c8bb44c7cc7eb92c457afb348a"}
Jul 27 17:25:08.769870 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:08.769847    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf" event={"ID":"fd727c1f-86ff-42be-982e-009e780bc9e8","Type":"ContainerStarted","Data":"bfd8a8e27acfb211bb2a8fe6ae4e80e3facbeb637af91f2b7964492ac54ece64"}
Jul 27 17:25:08.770059 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:08.770047    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:25:08.771746 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:08.771725    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:25:08.786895 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:08.786855    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7" podStartSLOduration=2.050210836 podStartE2EDuration="8.786843343s" totalImagesPullingTime="6.736632507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:08.785461431 +0000 UTC m=+51.800127876" watchObservedRunningTime="2026-07-27 17:25:08.786843343 +0000 UTC m=+51.801509781"
Jul 27 17:25:08.800538 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:08.800494    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf" podStartSLOduration=2.055839877 podStartE2EDuration="8.800482429s" totalImagesPullingTime="6.744642552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:08.800171011 +0000 UTC m=+51.814837455" watchObservedRunningTime="2026-07-27 17:25:08.800482429 +0000 UTC m=+51.815148873"
Jul 27 17:25:08.818510 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:08.818471    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd" podStartSLOduration=2.045682375 podStartE2EDuration="8.818458463s" totalImagesPullingTime="6.772776088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:08.817621713 +0000 UTC m=+51.832288155" watchObservedRunningTime="2026-07-27 17:25:08.818458463 +0000 UTC m=+51.833124907"
Jul 27 17:25:12.327498 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:12.327464    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:18.701781 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:18.701754    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z926n"
Jul 27 17:25:18.853832 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:18.853789    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:18.905879 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:18.905833    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:22.323994 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:22.323955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtsjk\" (UniqueName: \"kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk\") pod \"network-check-target-jljqh\" (UID: \"1f624899-5fbc-4977-94c6-6804349ae457\") " pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:25:22.324472 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:22.324032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret\") pod \"global-pull-secret-syncer-g285v\" (UID: \"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4\") " pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:25:22.324472 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:22.324076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs\") pod \"network-metrics-daemon-h66wv\" (UID: \"5531f102-84da-411c-99df-840e1f4b871a\") " pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:25:22.326888 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:22.326857    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 17:25:22.326991 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:22.326956    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 17:25:22.330190 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:22.330173    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 17:25:22.334385 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:22.334361    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 17:25:22.334494 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:22.334454    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs podName:5531f102-84da-411c-99df-840e1f4b871a nodeName:}" failed. No retries permitted until 2026-07-27 17:26:26.334431172 +0000 UTC m=+129.349097612 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs") pod "network-metrics-daemon-h66wv" (UID: "5531f102-84da-411c-99df-840e1f4b871a") : secret "metrics-daemon-secret" not found
Jul 27 17:25:22.336394 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:22.336372    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4-original-pull-secret\") pod \"global-pull-secret-syncer-g285v\" (UID: \"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4\") " pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:25:22.336495 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:22.336480    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 17:25:22.346532 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:22.346504    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtsjk\" (UniqueName: \"kubernetes.io/projected/1f624899-5fbc-4977-94c6-6804349ae457-kube-api-access-xtsjk\") pod \"network-check-target-jljqh\" (UID: \"1f624899-5fbc-4977-94c6-6804349ae457\") " pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:25:22.482084 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:22.482040    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g285v"
Jul 27 17:25:22.499712 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:22.499678    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6qpqw\""
Jul 27 17:25:22.506951 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:22.506924    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:25:22.611536 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:22.611502    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g285v"]
Jul 27 17:25:22.618764 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:25:22.618732    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ccecb8_cd50_4e6d_bf63_18ef88b8e8a4.slice/crio-59a4da0599dff97d416d91e0fe9bceb76a6448f723487e6c103fc4e121669940 WatchSource:0}: Error finding container 59a4da0599dff97d416d91e0fe9bceb76a6448f723487e6c103fc4e121669940: Status 404 returned error can't find the container with id 59a4da0599dff97d416d91e0fe9bceb76a6448f723487e6c103fc4e121669940
Jul 27 17:25:22.637398 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:22.637373    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jljqh"]
Jul 27 17:25:22.639832 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:25:22.639808    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f624899_5fbc_4977_94c6_6804349ae457.slice/crio-eeb3ea8916dfcb92799dccdf7b2582425f69508d3236d964a065e794d854bda7 WatchSource:0}: Error finding container eeb3ea8916dfcb92799dccdf7b2582425f69508d3236d964a065e794d854bda7: Status 404 returned error can't find the container with id eeb3ea8916dfcb92799dccdf7b2582425f69508d3236d964a065e794d854bda7
Jul 27 17:25:22.811087 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:22.811048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jljqh" event={"ID":"1f624899-5fbc-4977-94c6-6804349ae457","Type":"ContainerStarted","Data":"eeb3ea8916dfcb92799dccdf7b2582425f69508d3236d964a065e794d854bda7"}
Jul 27 17:25:22.812023 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:22.811997    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g285v" event={"ID":"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4","Type":"ContainerStarted","Data":"59a4da0599dff97d416d91e0fe9bceb76a6448f723487e6c103fc4e121669940"}
Jul 27 17:25:24.239626 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:24.239565    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bqcbv\" (UID: \"97944373-5fc9-4556-aac0-33c5aba5436c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:25:24.240038 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:24.239688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:25:24.240038 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:24.239693    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 17:25:24.240038 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:24.239722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:25:24.240038 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:24.239759    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert podName:97944373-5fc9-4556-aac0-33c5aba5436c nodeName:}" failed. No retries permitted until 2026-07-27 17:25:56.239741726 +0000 UTC m=+99.254408168 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-bqcbv" (UID: "97944373-5fc9-4556-aac0-33c5aba5436c") : secret "networking-console-plugin-cert" not found
Jul 27 17:25:24.240038 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:24.239822    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:25:24.240038 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:24.239830    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:25:24.240038 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:24.239849    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-778d9f886b-nqgxt: secret "image-registry-tls" not found
Jul 27 17:25:24.240038 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:24.239879    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls podName:77db0526-9ce6-4899-9e8c-07448e529a34 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:56.239863273 +0000 UTC m=+99.254529709 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls") pod "dns-default-z7f45" (UID: "77db0526-9ce6-4899-9e8c-07448e529a34") : secret "dns-default-metrics-tls" not found
Jul 27 17:25:24.240038 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:24.239896    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls podName:ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f nodeName:}" failed. No retries permitted until 2026-07-27 17:25:56.239887225 +0000 UTC m=+99.254553652 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls") pod "image-registry-778d9f886b-nqgxt" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f") : secret "image-registry-tls" not found
Jul 27 17:25:25.823090 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:25.823056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jljqh" event={"ID":"1f624899-5fbc-4977-94c6-6804349ae457","Type":"ContainerStarted","Data":"575ef364bc851f6dee3f7b56c36c19614cdebb5b5dd48f8b8e8fa9093fe2553d"}
Jul 27 17:25:25.823562 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:25.823196    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:25:25.841846 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:25.841791    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jljqh" podStartSLOduration=65.137248377 podStartE2EDuration="1m7.841776488s" totalImagesPullingTime="2.704528111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:25.840361796 +0000 UTC m=+68.855028241" watchObservedRunningTime="2026-07-27 17:25:25.841776488 +0000 UTC m=+68.856442931"
Jul 27 17:25:26.412423 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:26.412387    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:26.513276 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:26.513238    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log" limit=1024
Jul 27 17:25:29.837238 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:29.837202    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g285v" event={"ID":"f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4","Type":"ContainerStarted","Data":"878f25da5343986a824a4375dfb069fb8657efd701da466189efb7104aa864eb"}
Jul 27 17:25:29.852767 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:29.852696    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g285v" podStartSLOduration=65.251544486 podStartE2EDuration="1m11.85268143s" totalImagesPullingTime="6.601136944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:29.851609684 +0000 UTC m=+72.866276128" watchObservedRunningTime="2026-07-27 17:25:29.85268143 +0000 UTC m=+72.867347874"
Jul 27 17:25:56.293106 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:56.293060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:25:56.293106 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:56.293105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:25:56.293626 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:56.293164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bqcbv\" (UID: \"97944373-5fc9-4556-aac0-33c5aba5436c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:25:56.293626 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:56.293209    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:25:56.293626 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:56.293230    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-778d9f886b-nqgxt: secret "image-registry-tls" not found
Jul 27 17:25:56.293626 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:56.293260    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:25:56.293626 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:56.293289    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls podName:ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f nodeName:}" failed. No retries permitted until 2026-07-27 17:27:00.293274176 +0000 UTC m=+163.307940597 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls") pod "image-registry-778d9f886b-nqgxt" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f") : secret "image-registry-tls" not found
Jul 27 17:25:56.293626 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:56.293288    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 17:25:56.293626 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:56.293313    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls podName:77db0526-9ce6-4899-9e8c-07448e529a34 nodeName:}" failed. No retries permitted until 2026-07-27 17:27:00.293301241 +0000 UTC m=+163.307967679 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls") pod "dns-default-z7f45" (UID: "77db0526-9ce6-4899-9e8c-07448e529a34") : secret "dns-default-metrics-tls" not found
Jul 27 17:25:56.293626 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:25:56.293343    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert podName:97944373-5fc9-4556-aac0-33c5aba5436c nodeName:}" failed. No retries permitted until 2026-07-27 17:27:00.293329376 +0000 UTC m=+163.307995816 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-bqcbv" (UID: "97944373-5fc9-4556-aac0-33c5aba5436c") : secret "networking-console-plugin-cert" not found
Jul 27 17:25:56.829180 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:25:56.829151    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jljqh"
Jul 27 17:26:26.419686 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:26:26.419627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs\") pod \"network-metrics-daemon-h66wv\" (UID: \"5531f102-84da-411c-99df-840e1f4b871a\") " pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:26:26.420185 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:26:26.419788    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 17:26:26.420185 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:26:26.419853    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs podName:5531f102-84da-411c-99df-840e1f4b871a nodeName:}" failed. No retries permitted until 2026-07-27 17:28:28.419836447 +0000 UTC m=+251.434502885 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs") pod "network-metrics-daemon-h66wv" (UID: "5531f102-84da-411c-99df-840e1f4b871a") : secret "metrics-daemon-secret" not found
Jul 27 17:26:55.383197 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:26:55.383139    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv" podUID="97944373-5fc9-4556-aac0-33c5aba5436c"
Jul 27 17:26:55.400330 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:26:55.400300    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt" podUID="ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f"
Jul 27 17:26:55.428930 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:26:55.428891    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z7f45" podUID="77db0526-9ce6-4899-9e8c-07448e529a34"
Jul 27 17:26:55.494442 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:26:55.494404    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:26:56.079634 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:26:56.079599    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:26:56.079804 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:26:56.079596    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:27:00.379294 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:27:00.379247    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bqcbv\" (UID: \"97944373-5fc9-4556-aac0-33c5aba5436c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:27:00.379819 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:27:00.379331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:27:00.379819 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:27:00.379363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:27:00.379819 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:27:00.379414    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 17:27:00.379819 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:27:00.379461    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:27:00.379819 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:27:00.379468    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:27:00.379819 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:27:00.379488    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-778d9f886b-nqgxt: secret "image-registry-tls" not found
Jul 27 17:27:00.379819 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:27:00.379492    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert podName:97944373-5fc9-4556-aac0-33c5aba5436c nodeName:}" failed. No retries permitted until 2026-07-27 17:29:02.379472055 +0000 UTC m=+285.394138500 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-bqcbv" (UID: "97944373-5fc9-4556-aac0-33c5aba5436c") : secret "networking-console-plugin-cert" not found
Jul 27 17:27:00.379819 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:27:00.379520    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls podName:77db0526-9ce6-4899-9e8c-07448e529a34 nodeName:}" failed. No retries permitted until 2026-07-27 17:29:02.379510345 +0000 UTC m=+285.394176781 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls") pod "dns-default-z7f45" (UID: "77db0526-9ce6-4899-9e8c-07448e529a34") : secret "dns-default-metrics-tls" not found
Jul 27 17:27:00.379819 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:27:00.379539    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls podName:ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f nodeName:}" failed. No retries permitted until 2026-07-27 17:29:02.379526159 +0000 UTC m=+285.394192593 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls") pod "image-registry-778d9f886b-nqgxt" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f") : secret "image-registry-tls" not found
Jul 27 17:27:07.471940 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:27:07.471896    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7f45"
Jul 27 17:27:08.770386 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:27:08.770337    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf" podUID="fd727c1f-86ff-42be-982e-009e780bc9e8" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.11:8000/readyz\": dial tcp 10.132.0.11:8000: connect: connection refused"
Jul 27 17:27:09.118939 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:27:09.118852    2580 generic.go:356] "Generic (PLEG): container finished" podID="fd727c1f-86ff-42be-982e-009e780bc9e8" containerID="bfd8a8e27acfb211bb2a8fe6ae4e80e3facbeb637af91f2b7964492ac54ece64" exitCode=1
Jul 27 17:27:09.119100 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:27:09.118930    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf" event={"ID":"fd727c1f-86ff-42be-982e-009e780bc9e8","Type":"ContainerDied","Data":"bfd8a8e27acfb211bb2a8fe6ae4e80e3facbeb637af91f2b7964492ac54ece64"}
Jul 27 17:27:09.119350 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:27:09.119328    2580 scope.go:117] "RemoveContainer" containerID="bfd8a8e27acfb211bb2a8fe6ae4e80e3facbeb637af91f2b7964492ac54ece64"
Jul 27 17:27:09.120265 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:27:09.120237    2580 generic.go:356] "Generic (PLEG): container finished" podID="12e2a527-997c-4862-ad29-6862cc830694" containerID="3c518cb14d3791a7bf92f98bd381fcda528ef0c8bb44c7cc7eb92c457afb348a" exitCode=255
Jul 27 17:27:09.120378 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:27:09.120282    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd" event={"ID":"12e2a527-997c-4862-ad29-6862cc830694","Type":"ContainerDied","Data":"3c518cb14d3791a7bf92f98bd381fcda528ef0c8bb44c7cc7eb92c457afb348a"}
Jul 27 17:27:09.120545 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:27:09.120529    2580 scope.go:117] "RemoveContainer" containerID="3c518cb14d3791a7bf92f98bd381fcda528ef0c8bb44c7cc7eb92c457afb348a"
Jul 27 17:27:10.125067 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:27:10.124975    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf" event={"ID":"fd727c1f-86ff-42be-982e-009e780bc9e8","Type":"ContainerStarted","Data":"db8ad474f2a3540ac8024615577db6086bd35984fbb578360c1b022c53f77b72"}
Jul 27 17:27:10.125507 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:27:10.125278    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:27:10.125955 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:27:10.125925    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:27:10.126740 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:27:10.126718    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd" event={"ID":"12e2a527-997c-4862-ad29-6862cc830694","Type":"ContainerStarted","Data":"976e2c8f19c866e1bc8e29ba98f29bd6c1055e9c7addc53a74167c823ad94f23"}
Jul 27 17:27:10.470245 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:27:10.470197    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:28:28.434879 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:28.434831    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs\") pod \"network-metrics-daemon-h66wv\" (UID: \"5531f102-84da-411c-99df-840e1f4b871a\") " pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:28:28.435370 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:28.434977    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 17:28:28.435370 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:28.435039    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs podName:5531f102-84da-411c-99df-840e1f4b871a nodeName:}" failed. No retries permitted until 2026-07-27 17:30:30.435022463 +0000 UTC m=+373.449688907 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs") pod "network-metrics-daemon-h66wv" (UID: "5531f102-84da-411c-99df-840e1f4b871a") : secret "metrics-daemon-secret" not found
Jul 27 17:28:40.016000 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.015916    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vghm6"]
Jul 27 17:28:40.022773 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.022742    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:40.026866 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.026846    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 17:28:40.027388 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.027368    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 17:28:40.027528 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.027366    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 17:28:40.027635 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.027379    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 17:28:40.027635 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.027407    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rkvgp\""
Jul 27 17:28:40.038630 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.038607    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vghm6"]
Jul 27 17:28:40.116776 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.116750    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhm7x\" (UniqueName: \"kubernetes.io/projected/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-api-access-nhm7x\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:40.116905 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.116803    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7333a6f-a9f9-48a7-998a-cc9438b6031b-data-volume\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:40.116905 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.116844    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:40.116905 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.116885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7333a6f-a9f9-48a7-998a-cc9438b6031b-crio-socket\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:40.117006 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.116940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:40.218235 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.218204    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:40.218373 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.218254    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7333a6f-a9f9-48a7-998a-cc9438b6031b-crio-socket\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:40.218373 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.218280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:40.218373 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.218314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhm7x\" (UniqueName: \"kubernetes.io/projected/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-api-access-nhm7x\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:40.218373 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.218342    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7333a6f-a9f9-48a7-998a-cc9438b6031b-crio-socket\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:40.218373 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.218346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7333a6f-a9f9-48a7-998a-cc9438b6031b-data-volume\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:40.218667 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:40.218450    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:40.218667 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:40.218482    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:28:40.218667 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:40.218505    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls podName:f7333a6f-a9f9-48a7-998a-cc9438b6031b nodeName:}" failed. No retries permitted until 2026-07-27 17:28:40.718490771 +0000 UTC m=+263.733157224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vghm6" (UID: "f7333a6f-a9f9-48a7-998a-cc9438b6031b") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:40.218667 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:40.218554    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm podName:f7333a6f-a9f9-48a7-998a-cc9438b6031b nodeName:}" failed. No retries permitted until 2026-07-27 17:28:40.718535834 +0000 UTC m=+263.733202272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vghm6" (UID: "f7333a6f-a9f9-48a7-998a-cc9438b6031b") : configmap "kube-rbac-proxy" not found
Jul 27 17:28:40.218667 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.218662    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7333a6f-a9f9-48a7-998a-cc9438b6031b-data-volume\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:40.227543 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.227519    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhm7x\" (UniqueName: \"kubernetes.io/projected/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-api-access-nhm7x\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:40.721399 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.721358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:40.721606 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:40.721422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:40.721606 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:40.721487    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:28:40.721606 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:40.721504    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:40.721606 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:40.721551    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm podName:f7333a6f-a9f9-48a7-998a-cc9438b6031b nodeName:}" failed. No retries permitted until 2026-07-27 17:28:41.721536714 +0000 UTC m=+264.736203150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vghm6" (UID: "f7333a6f-a9f9-48a7-998a-cc9438b6031b") : configmap "kube-rbac-proxy" not found
Jul 27 17:28:40.721606 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:40.721563    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls podName:f7333a6f-a9f9-48a7-998a-cc9438b6031b nodeName:}" failed. No retries permitted until 2026-07-27 17:28:41.72155731 +0000 UTC m=+264.736223732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vghm6" (UID: "f7333a6f-a9f9-48a7-998a-cc9438b6031b") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:41.730129 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:41.730090    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:41.730504 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:41.730168    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:41.730504 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:41.730249    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:41.730504 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:41.730280    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:28:41.730504 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:41.730320    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls podName:f7333a6f-a9f9-48a7-998a-cc9438b6031b nodeName:}" failed. No retries permitted until 2026-07-27 17:28:43.730303498 +0000 UTC m=+266.744969940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vghm6" (UID: "f7333a6f-a9f9-48a7-998a-cc9438b6031b") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:41.730504 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:41.730343    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm podName:f7333a6f-a9f9-48a7-998a-cc9438b6031b nodeName:}" failed. No retries permitted until 2026-07-27 17:28:43.730330734 +0000 UTC m=+266.744997170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vghm6" (UID: "f7333a6f-a9f9-48a7-998a-cc9438b6031b") : configmap "kube-rbac-proxy" not found
Jul 27 17:28:42.217106 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:42.217077    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-trb87_5ac14a62-8827-4d06-a67d-2ac290fb0ae7/dns-node-resolver/0.log"
Jul 27 17:28:43.216684 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:43.216652    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rwn2d_ce020319-484a-4868-86f5-4bb9683bac2f/node-ca/0.log"
Jul 27 17:28:43.622529 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:43.622454    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-677g9_e66a5198-bfde-4dc9-9bab-0b58f4e80b37/serve-healthcheck-canary/0.log"
Jul 27 17:28:43.746081 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:43.746047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:43.746225 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:43.746117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:43.746225 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:43.746160    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:28:43.746225 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:43.746207    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:43.746225 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:43.746224    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm podName:f7333a6f-a9f9-48a7-998a-cc9438b6031b nodeName:}" failed. No retries permitted until 2026-07-27 17:28:47.746208341 +0000 UTC m=+270.760874786 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vghm6" (UID: "f7333a6f-a9f9-48a7-998a-cc9438b6031b") : configmap "kube-rbac-proxy" not found
Jul 27 17:28:43.746361 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:43.746246    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls podName:f7333a6f-a9f9-48a7-998a-cc9438b6031b nodeName:}" failed. No retries permitted until 2026-07-27 17:28:47.746234911 +0000 UTC m=+270.760901367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vghm6" (UID: "f7333a6f-a9f9-48a7-998a-cc9438b6031b") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:47.778054 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:47.777992    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:47.778520 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:47.778108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:47.778520 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:47.778138    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:28:47.778520 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:47.778213    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm podName:f7333a6f-a9f9-48a7-998a-cc9438b6031b nodeName:}" failed. No retries permitted until 2026-07-27 17:28:55.778195905 +0000 UTC m=+278.792862352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vghm6" (UID: "f7333a6f-a9f9-48a7-998a-cc9438b6031b") : configmap "kube-rbac-proxy" not found
Jul 27 17:28:47.778520 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:47.778241    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:47.778520 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:47.778302    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls podName:f7333a6f-a9f9-48a7-998a-cc9438b6031b nodeName:}" failed. No retries permitted until 2026-07-27 17:28:55.778285283 +0000 UTC m=+278.792951718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vghm6" (UID: "f7333a6f-a9f9-48a7-998a-cc9438b6031b") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:55.845518 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:55.845476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:55.845945 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:55.845559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:55.845945 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:55.845694    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:55.845945 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:55.845771    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls podName:f7333a6f-a9f9-48a7-998a-cc9438b6031b nodeName:}" failed. No retries permitted until 2026-07-27 17:29:11.845755397 +0000 UTC m=+294.860421839 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vghm6" (UID: "f7333a6f-a9f9-48a7-998a-cc9438b6031b") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:55.846072 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:55.845992    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7333a6f-a9f9-48a7-998a-cc9438b6031b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:28:59.080785 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:59.080740    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv" podUID="97944373-5fc9-4556-aac0-33c5aba5436c"
Jul 27 17:28:59.080785 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:28:59.080742    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt" podUID="ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f"
Jul 27 17:28:59.445029 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:59.445000    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:28:59.445200 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:28:59.445160    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:29:02.397422 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:02.397366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bqcbv\" (UID: \"97944373-5fc9-4556-aac0-33c5aba5436c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:29:02.397845 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:02.397450    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:29:02.397845 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:02.397471    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:29:02.399782 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:02.399753    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77db0526-9ce6-4899-9e8c-07448e529a34-metrics-tls\") pod \"dns-default-z7f45\" (UID: \"77db0526-9ce6-4899-9e8c-07448e529a34\") " pod="openshift-dns/dns-default-z7f45"
Jul 27 17:29:02.399950 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:02.399927    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/97944373-5fc9-4556-aac0-33c5aba5436c-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bqcbv\" (UID: \"97944373-5fc9-4556-aac0-33c5aba5436c\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:29:02.400012 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:02.399932    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls\") pod \"image-registry-778d9f886b-nqgxt\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") " pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:29:02.449575 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:02.449552    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mgql4\""
Jul 27 17:29:02.449698 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:02.449552    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-krvhz\""
Jul 27 17:29:02.456427 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:02.456405    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:29:02.456523 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:02.456427    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"
Jul 27 17:29:02.590111 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:02.590083    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-778d9f886b-nqgxt"]
Jul 27 17:29:02.593053 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:29:02.593024    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc75585_b2ae_4110_a2ca_d3b2fbeaab1f.slice/crio-109252064ee2d032d68e65a926c6533b537f76b9cbd06bf9819a8190b2028909 WatchSource:0}: Error finding container 109252064ee2d032d68e65a926c6533b537f76b9cbd06bf9819a8190b2028909: Status 404 returned error can't find the container with id 109252064ee2d032d68e65a926c6533b537f76b9cbd06bf9819a8190b2028909
Jul 27 17:29:02.602784 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:02.602762    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv"]
Jul 27 17:29:02.605682 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:29:02.605654    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97944373_5fc9_4556_aac0_33c5aba5436c.slice/crio-0f9954ae4c2e6a24cd7956117698be38b5e8f8b176c2727bf282f887a66b6858 WatchSource:0}: Error finding container 0f9954ae4c2e6a24cd7956117698be38b5e8f8b176c2727bf282f887a66b6858: Status 404 returned error can't find the container with id 0f9954ae4c2e6a24cd7956117698be38b5e8f8b176c2727bf282f887a66b6858
Jul 27 17:29:02.674919 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:02.674901    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pwzz8\""
Jul 27 17:29:02.683038 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:02.683020    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7f45"
Jul 27 17:29:02.814636 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:02.814596    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z7f45"]
Jul 27 17:29:02.818381 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:29:02.818353    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77db0526_9ce6_4899_9e8c_07448e529a34.slice/crio-df19a24255c3f4b683e429b2b047c2db37fb26f66a0beaaeaf706bb529f573a8 WatchSource:0}: Error finding container df19a24255c3f4b683e429b2b047c2db37fb26f66a0beaaeaf706bb529f573a8: Status 404 returned error can't find the container with id df19a24255c3f4b683e429b2b047c2db37fb26f66a0beaaeaf706bb529f573a8
Jul 27 17:29:03.459026 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:03.458987    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt" event={"ID":"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f","Type":"ContainerStarted","Data":"b0852e8ead131e15dbe5bb55301db96c13325890d8c18c3ec4116cd314dbd610"}
Jul 27 17:29:03.459491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:03.459046    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt" event={"ID":"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f","Type":"ContainerStarted","Data":"109252064ee2d032d68e65a926c6533b537f76b9cbd06bf9819a8190b2028909"}
Jul 27 17:29:03.459491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:03.459067    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:29:03.460443 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:03.460400    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv" event={"ID":"97944373-5fc9-4556-aac0-33c5aba5436c","Type":"ContainerStarted","Data":"0f9954ae4c2e6a24cd7956117698be38b5e8f8b176c2727bf282f887a66b6858"}
Jul 27 17:29:03.461461 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:03.461435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7f45" event={"ID":"77db0526-9ce6-4899-9e8c-07448e529a34","Type":"ContainerStarted","Data":"df19a24255c3f4b683e429b2b047c2db37fb26f66a0beaaeaf706bb529f573a8"}
Jul 27 17:29:03.489317 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:03.489272    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt" podStartSLOduration=263.489259043 podStartE2EDuration="4m23.489259043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:24:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:03.487976545 +0000 UTC m=+286.502642990" watchObservedRunningTime="2026-07-27 17:29:03.489259043 +0000 UTC m=+286.503925464"
Jul 27 17:29:04.466282 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:04.466240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv" event={"ID":"97944373-5fc9-4556-aac0-33c5aba5436c","Type":"ContainerStarted","Data":"4cdf45d2ddf01a59e2c7ef2381d45343990e9e71b6be2c29758f33242dbabbcd"}
Jul 27 17:29:04.484429 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:04.484374    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-bqcbv" podStartSLOduration=273.291889112 podStartE2EDuration="4m34.484356384s" totalImagesPullingTime="1.192467272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:04.483571556 +0000 UTC m=+287.498238002" watchObservedRunningTime="2026-07-27 17:29:04.484356384 +0000 UTC m=+287.499022829"
Jul 27 17:29:06.473621 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:06.473570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7f45" event={"ID":"77db0526-9ce6-4899-9e8c-07448e529a34","Type":"ContainerStarted","Data":"40ca38f02143a206b15ec73513204ccabe74bc15147379fa2d110afc64adfd9d"}
Jul 27 17:29:06.473961 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:06.473641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7f45" event={"ID":"77db0526-9ce6-4899-9e8c-07448e529a34","Type":"ContainerStarted","Data":"f54e8c3c7e6fac5e865e85b35dd317110428b8104477c7b3b2e96a8f29cd4a25"}
Jul 27 17:29:06.473961 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:06.473716    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z7f45"
Jul 27 17:29:06.492222 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:06.492179    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z7f45" podStartSLOduration=251.301013632 podStartE2EDuration="4m14.492167051s" totalImagesPullingTime="3.191153419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:06.490834861 +0000 UTC m=+289.505501307" watchObservedRunningTime="2026-07-27 17:29:06.492167051 +0000 UTC m=+289.506833495"
Jul 27 17:29:09.482971 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:09.482891    2580 generic.go:356] "Generic (PLEG): container finished" podID="fd727c1f-86ff-42be-982e-009e780bc9e8" containerID="db8ad474f2a3540ac8024615577db6086bd35984fbb578360c1b022c53f77b72" exitCode=1
Jul 27 17:29:09.482971 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:09.482961    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf" event={"ID":"fd727c1f-86ff-42be-982e-009e780bc9e8","Type":"ContainerDied","Data":"db8ad474f2a3540ac8024615577db6086bd35984fbb578360c1b022c53f77b72"}
Jul 27 17:29:09.483454 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:09.483017    2580 scope.go:117] "RemoveContainer" containerID="bfd8a8e27acfb211bb2a8fe6ae4e80e3facbeb637af91f2b7964492ac54ece64"
Jul 27 17:29:09.483454 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:09.483346    2580 scope.go:117] "RemoveContainer" containerID="db8ad474f2a3540ac8024615577db6086bd35984fbb578360c1b022c53f77b72"
Jul 27 17:29:09.483548 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:29:09.483526    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-585f4457b9-s6wnf_open-cluster-management-agent-addon(fd727c1f-86ff-42be-982e-009e780bc9e8)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf" podUID="fd727c1f-86ff-42be-982e-009e780bc9e8"
Jul 27 17:29:09.484751 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:09.484733    2580 generic.go:356] "Generic (PLEG): container finished" podID="12e2a527-997c-4862-ad29-6862cc830694" containerID="976e2c8f19c866e1bc8e29ba98f29bd6c1055e9c7addc53a74167c823ad94f23" exitCode=255
Jul 27 17:29:09.484821 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:09.484762    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd" event={"ID":"12e2a527-997c-4862-ad29-6862cc830694","Type":"ContainerDied","Data":"976e2c8f19c866e1bc8e29ba98f29bd6c1055e9c7addc53a74167c823ad94f23"}
Jul 27 17:29:09.485060 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:09.485048    2580 scope.go:117] "RemoveContainer" containerID="976e2c8f19c866e1bc8e29ba98f29bd6c1055e9c7addc53a74167c823ad94f23"
Jul 27 17:29:09.485177 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:29:09.485160    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd_open-cluster-management-agent-addon(12e2a527-997c-4862-ad29-6862cc830694)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd" podUID="12e2a527-997c-4862-ad29-6862cc830694"
Jul 27 17:29:09.493680 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:09.493667    2580 scope.go:117] "RemoveContainer" containerID="3c518cb14d3791a7bf92f98bd381fcda528ef0c8bb44c7cc7eb92c457afb348a"
Jul 27 17:29:10.125695 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:10.125659    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:29:10.489345 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:10.489320    2580 scope.go:117] "RemoveContainer" containerID="db8ad474f2a3540ac8024615577db6086bd35984fbb578360c1b022c53f77b72"
Jul 27 17:29:10.489790 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:29:10.489470    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-585f4457b9-s6wnf_open-cluster-management-agent-addon(fd727c1f-86ff-42be-982e-009e780bc9e8)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf" podUID="fd727c1f-86ff-42be-982e-009e780bc9e8"
Jul 27 17:29:11.108148 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:11.108108    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd"
Jul 27 17:29:11.108464 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:11.108449    2580 scope.go:117] "RemoveContainer" containerID="976e2c8f19c866e1bc8e29ba98f29bd6c1055e9c7addc53a74167c823ad94f23"
Jul 27 17:29:11.108650 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:29:11.108630    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd_open-cluster-management-agent-addon(12e2a527-997c-4862-ad29-6862cc830694)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd" podUID="12e2a527-997c-4862-ad29-6862cc830694"
Jul 27 17:29:11.114830 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:11.114811    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:29:11.132837 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:11.132803    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7" podUID="e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 27 17:29:11.493135 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:11.493101    2580 scope.go:117] "RemoveContainer" containerID="db8ad474f2a3540ac8024615577db6086bd35984fbb578360c1b022c53f77b72"
Jul 27 17:29:11.493612 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:29:11.493298    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-585f4457b9-s6wnf_open-cluster-management-agent-addon(fd727c1f-86ff-42be-982e-009e780bc9e8)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf" podUID="fd727c1f-86ff-42be-982e-009e780bc9e8"
Jul 27 17:29:11.869134 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:11.869047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:29:11.871329 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:11.871308    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7333a6f-a9f9-48a7-998a-cc9438b6031b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vghm6\" (UID: \"f7333a6f-a9f9-48a7-998a-cc9438b6031b\") " pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:29:12.131248 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:12.131170    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vghm6"
Jul 27 17:29:12.258733 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:12.258699    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vghm6"]
Jul 27 17:29:12.261983 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:29:12.261957    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7333a6f_a9f9_48a7_998a_cc9438b6031b.slice/crio-2ff81b676b37c53855aa95dea5e7795dc1e0c7185af1f1c6e7ecb650d58e4bb3 WatchSource:0}: Error finding container 2ff81b676b37c53855aa95dea5e7795dc1e0c7185af1f1c6e7ecb650d58e4bb3: Status 404 returned error can't find the container with id 2ff81b676b37c53855aa95dea5e7795dc1e0c7185af1f1c6e7ecb650d58e4bb3
Jul 27 17:29:12.497856 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:12.497822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vghm6" event={"ID":"f7333a6f-a9f9-48a7-998a-cc9438b6031b","Type":"ContainerStarted","Data":"2ff81b676b37c53855aa95dea5e7795dc1e0c7185af1f1c6e7ecb650d58e4bb3"}
Jul 27 17:29:13.470791 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:29:13.470748    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h66wv" podUID="5531f102-84da-411c-99df-840e1f4b871a"
Jul 27 17:29:16.478429 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:16.478400    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z7f45"
Jul 27 17:29:17.406626 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:17.406600    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 17:29:17.519627 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:17.519432    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vghm6" event={"ID":"f7333a6f-a9f9-48a7-998a-cc9438b6031b","Type":"ContainerStarted","Data":"7adcc6b710c98cb2f2236896eeb6d766b55dd4181eb253a05a60e300cafcdf14"}
Jul 27 17:29:20.516285 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:20.516265    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:29:20.530873 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:20.530846    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vghm6" event={"ID":"f7333a6f-a9f9-48a7-998a-cc9438b6031b","Type":"ContainerStarted","Data":"a001fb2f4b849b7f5af3b0cb7eaa3592dc96782b42b7053aa37e95ed53411439"}
Jul 27 17:29:21.133190 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:21.133142    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7" podUID="e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 27 17:29:22.431821 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.431788    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nfm4k"]
Jul 27 17:29:22.435231 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.435203    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.438318 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.438289    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 17:29:22.438648 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.438626    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 17:29:22.438756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.438651    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 17:29:22.439357 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.439338    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c6csp\""
Jul 27 17:29:22.439357 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.439345    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 17:29:22.439538 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.439381    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 17:29:22.439653 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.439635    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 17:29:22.454632 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.454608    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f9bda91-cbf2-440e-b218-97fa4a43709f-root\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.454761 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.454650    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.454761 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.454689    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-textfile\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.454896 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.454760    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-accelerators-collector-config\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.454896 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.454835    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-wtmp\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.454896 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.454867    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6qjb\" (UniqueName: \"kubernetes.io/projected/1f9bda91-cbf2-440e-b218-97fa4a43709f-kube-api-access-s6qjb\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.455160 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.454901    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f9bda91-cbf2-440e-b218-97fa4a43709f-metrics-client-ca\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.455160 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.454934    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-tls\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.455160 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.455020    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f9bda91-cbf2-440e-b218-97fa4a43709f-sys\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.462185 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.462151    2580 patch_prober.go:28] interesting pod/image-registry-778d9f886b-nqgxt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 27 17:29:22.462280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.462214    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt" podUID="ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 17:29:22.471118 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.471096    2580 scope.go:117] "RemoveContainer" containerID="976e2c8f19c866e1bc8e29ba98f29bd6c1055e9c7addc53a74167c823ad94f23"
Jul 27 17:29:22.540572 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.540546    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c48ffbfb-vr2rd" event={"ID":"12e2a527-997c-4862-ad29-6862cc830694","Type":"ContainerStarted","Data":"77776a5ccdf9d5f875d6c1a9854e2bbb8a3b7ae9c9a6357ee4d8db3f4685d655"}
Jul 27 17:29:22.556167 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.556134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-textfile\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.556296 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.556183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-accelerators-collector-config\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.556296 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.556251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-wtmp\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.556296 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.556279    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qjb\" (UniqueName: \"kubernetes.io/projected/1f9bda91-cbf2-440e-b218-97fa4a43709f-kube-api-access-s6qjb\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.556463 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.556331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f9bda91-cbf2-440e-b218-97fa4a43709f-metrics-client-ca\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.556463 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.556364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-tls\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.556463 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.556398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f9bda91-cbf2-440e-b218-97fa4a43709f-sys\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.556463 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.556433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f9bda91-cbf2-440e-b218-97fa4a43709f-root\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.556679 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.556541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-textfile\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.556679 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:29:22.556570    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 17:29:22.556679 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.556616    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-wtmp\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.556679 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:29:22.556643    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-tls podName:1f9bda91-cbf2-440e-b218-97fa4a43709f nodeName:}" failed. No retries permitted until 2026-07-27 17:29:23.056624701 +0000 UTC m=+306.071291139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-tls") pod "node-exporter-nfm4k" (UID: "1f9bda91-cbf2-440e-b218-97fa4a43709f") : secret "node-exporter-tls" not found
Jul 27 17:29:22.556874 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.556691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f9bda91-cbf2-440e-b218-97fa4a43709f-sys\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.556874 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.556741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f9bda91-cbf2-440e-b218-97fa4a43709f-root\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.556874 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.556777    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-accelerators-collector-config\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.556874 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.556816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.557135 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.557110    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f9bda91-cbf2-440e-b218-97fa4a43709f-metrics-client-ca\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.559500 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.559477    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:22.572694 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:22.572662    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6qjb\" (UniqueName: \"kubernetes.io/projected/1f9bda91-cbf2-440e-b218-97fa4a43709f-kube-api-access-s6qjb\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:23.060844 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:23.060808    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-tls\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:23.061024 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:29:23.060976    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 17:29:23.061094 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:29:23.061051    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-tls podName:1f9bda91-cbf2-440e-b218-97fa4a43709f nodeName:}" failed. No retries permitted until 2026-07-27 17:29:24.06103195 +0000 UTC m=+307.075698393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-tls") pod "node-exporter-nfm4k" (UID: "1f9bda91-cbf2-440e-b218-97fa4a43709f") : secret "node-exporter-tls" not found
Jul 27 17:29:24.071124 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:24.071079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-tls\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:24.073485 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:24.073460    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f9bda91-cbf2-440e-b218-97fa4a43709f-node-exporter-tls\") pod \"node-exporter-nfm4k\" (UID: \"1f9bda91-cbf2-440e-b218-97fa4a43709f\") " pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:24.245863 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:24.245830    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nfm4k"
Jul 27 17:29:24.471349 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:24.471318    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:29:24.743683 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:29:24.743640    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f9bda91_cbf2_440e_b218_97fa4a43709f.slice/crio-835a3c4ec6d159686d21cd8d788eb1e952f93fc5ecf3f58de42ae94190cb4e3d WatchSource:0}: Error finding container 835a3c4ec6d159686d21cd8d788eb1e952f93fc5ecf3f58de42ae94190cb4e3d: Status 404 returned error can't find the container with id 835a3c4ec6d159686d21cd8d788eb1e952f93fc5ecf3f58de42ae94190cb4e3d
Jul 27 17:29:25.471302 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:25.471267    2580 scope.go:117] "RemoveContainer" containerID="db8ad474f2a3540ac8024615577db6086bd35984fbb578360c1b022c53f77b72"
Jul 27 17:29:25.471789 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:25.471642    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:29:25.553095 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:25.553057    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfm4k" event={"ID":"1f9bda91-cbf2-440e-b218-97fa4a43709f","Type":"ContainerStarted","Data":"835a3c4ec6d159686d21cd8d788eb1e952f93fc5ecf3f58de42ae94190cb4e3d"}
Jul 27 17:29:25.555387 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:25.555354    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vghm6" event={"ID":"f7333a6f-a9f9-48a7-998a-cc9438b6031b","Type":"ContainerStarted","Data":"cd933235d8565c083478c63ea5a3472551dc63efb808a27e9684877bc900f27a"}
Jul 27 17:29:25.579599 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:25.579532    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vghm6" podStartSLOduration=34.164606155 podStartE2EDuration="46.579516901s" totalImagesPullingTime="12.414910746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:28:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:25.578192808 +0000 UTC m=+308.592859267" watchObservedRunningTime="2026-07-27 17:29:25.579516901 +0000 UTC m=+308.594183345"
Jul 27 17:29:26.559902 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:26.559861    2580 generic.go:356] "Generic (PLEG): container finished" podID="1f9bda91-cbf2-440e-b218-97fa4a43709f" containerID="da3f06f9ff739db45d1d374ab852c1bc579066f5d55bc5c71a8cdc264dcb6f75" exitCode=0
Jul 27 17:29:26.560322 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:26.559951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfm4k" event={"ID":"1f9bda91-cbf2-440e-b218-97fa4a43709f","Type":"ContainerDied","Data":"da3f06f9ff739db45d1d374ab852c1bc579066f5d55bc5c71a8cdc264dcb6f75"}
Jul 27 17:29:26.561771 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:26.561747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf" event={"ID":"fd727c1f-86ff-42be-982e-009e780bc9e8","Type":"ContainerStarted","Data":"9bef86b595b204465ac918410dcb6196c4c71375cdcb50a8644a90b611f93de4"}
Jul 27 17:29:26.562147 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:26.562125    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:29:26.563724 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:26.563649    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f4457b9-s6wnf"
Jul 27 17:29:27.423197 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:27.423162    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-778d9f886b-nqgxt"]
Jul 27 17:29:27.566677 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:27.566640    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfm4k" event={"ID":"1f9bda91-cbf2-440e-b218-97fa4a43709f","Type":"ContainerStarted","Data":"5032f36fe9ec1a55337df901992ebfb00d81658636ab1d8d74abcac97652a46f"}
Jul 27 17:29:27.567066 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:27.566707    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nfm4k" event={"ID":"1f9bda91-cbf2-440e-b218-97fa4a43709f","Type":"ContainerStarted","Data":"623291d5de2c512b89b1f2688a2953721eeee061de5578213e96989c3bd93cd7"}
Jul 27 17:29:27.590716 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:27.590674    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nfm4k" podStartSLOduration=4.625121026 podStartE2EDuration="5.590658645s" totalImagesPullingTime="900.275183ms" totalInitContainerRuntime="65.262436ms" isStatefulPod=true podCreationTimestamp="2026-07-27 17:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:27.590133082 +0000 UTC m=+310.604799527" watchObservedRunningTime="2026-07-27 17:29:27.590658645 +0000 UTC m=+310.605325088"
Jul 27 17:29:31.132497 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:31.132458    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7" podUID="e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 27 17:29:31.132910 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:31.132527    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7"
Jul 27 17:29:31.133023 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:31.132984    2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"de5f127905482ec710530eb089c780c77d4e7c0cb5c1b28a52c163b1f6047a06"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 27 17:29:31.133060 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:31.133043    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7" podUID="e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe" containerName="service-proxy" containerID="cri-o://de5f127905482ec710530eb089c780c77d4e7c0cb5c1b28a52c163b1f6047a06" gracePeriod=30
Jul 27 17:29:31.581322 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:31.581288    2580 generic.go:356] "Generic (PLEG): container finished" podID="e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe" containerID="de5f127905482ec710530eb089c780c77d4e7c0cb5c1b28a52c163b1f6047a06" exitCode=2
Jul 27 17:29:31.581528 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:31.581354    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7" event={"ID":"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe","Type":"ContainerDied","Data":"de5f127905482ec710530eb089c780c77d4e7c0cb5c1b28a52c163b1f6047a06"}
Jul 27 17:29:31.581528 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:31.581397    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6785dd95d-vmdf7" event={"ID":"e4ec7ec0-8696-482a-ae3a-3e8cb3d47afe","Type":"ContainerStarted","Data":"35d18266f1c6adc072446c1a6cdc2d35b7fed7f9997eae3a453781db056f8fba"}
Jul 27 17:29:52.441570 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:52.441489    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt" podUID="ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f" containerName="registry" containerID="cri-o://b0852e8ead131e15dbe5bb55301db96c13325890d8c18c3ec4116cd314dbd610" gracePeriod=30
Jul 27 17:29:52.649729 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:52.649695    2580 generic.go:356] "Generic (PLEG): container finished" podID="ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f" containerID="b0852e8ead131e15dbe5bb55301db96c13325890d8c18c3ec4116cd314dbd610" exitCode=0
Jul 27 17:29:52.649892 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:52.649773    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt" event={"ID":"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f","Type":"ContainerDied","Data":"b0852e8ead131e15dbe5bb55301db96c13325890d8c18c3ec4116cd314dbd610"}
Jul 27 17:29:53.241942 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.241913    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:29:53.304437 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.304412    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-installation-pull-secrets\") pod \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") "
Jul 27 17:29:53.304614 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.304453    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfqtd\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-kube-api-access-pfqtd\") pod \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") "
Jul 27 17:29:53.304614 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.304475    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-trusted-ca\") pod \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") "
Jul 27 17:29:53.304614 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.304507    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls\") pod \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") "
Jul 27 17:29:53.304614 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.304597    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-certificates\") pod \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") "
Jul 27 17:29:53.304837 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.304625    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-bound-sa-token\") pod \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") "
Jul 27 17:29:53.304837 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.304667    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-image-registry-private-configuration\") pod \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") "
Jul 27 17:29:53.304837 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.304694    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-ca-trust-extracted\") pod \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\" (UID: \"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f\") "
Jul 27 17:29:53.305029 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.304946    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:29:53.305029 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.304988    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:29:53.307079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.307048    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:29:53.307207 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.307079    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:29:53.307207 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.307141    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:29:53.307207 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.307141    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-kube-api-access-pfqtd" (OuterVolumeSpecName: "kube-api-access-pfqtd") pod "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f"). InnerVolumeSpecName "kube-api-access-pfqtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:29:53.307374 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.307296    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:29:53.313722 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.313693    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f" (UID: "ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:29:53.406135 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.406109    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-tls\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:29:53.406135 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.406135    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-registry-certificates\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:29:53.406282 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.406146    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-bound-sa-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:29:53.406282 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.406155    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-image-registry-private-configuration\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:29:53.406282 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.406164    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-ca-trust-extracted\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:29:53.406282 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.406173    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-installation-pull-secrets\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:29:53.406282 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.406182    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfqtd\" (UniqueName: \"kubernetes.io/projected/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-kube-api-access-pfqtd\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:29:53.406282 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.406190    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f-trusted-ca\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:29:53.654490 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.654461    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt" event={"ID":"ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f","Type":"ContainerDied","Data":"109252064ee2d032d68e65a926c6533b537f76b9cbd06bf9819a8190b2028909"}
Jul 27 17:29:53.654490 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.654483    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-778d9f886b-nqgxt"
Jul 27 17:29:53.654989 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.654520    2580 scope.go:117] "RemoveContainer" containerID="b0852e8ead131e15dbe5bb55301db96c13325890d8c18c3ec4116cd314dbd610"
Jul 27 17:29:53.675634 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.675611    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-778d9f886b-nqgxt"]
Jul 27 17:29:53.680806 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:53.680783    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-778d9f886b-nqgxt"]
Jul 27 17:29:55.475530 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:29:55.475496    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f" path="/var/lib/kubelet/pods/ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f/volumes"
Jul 27 17:30:00.780025 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:30:00.779993    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7f45_77db0526-9ce6-4899-9e8c-07448e529a34/dns/0.log"
Jul 27 17:30:00.786959 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:30:00.786940    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7f45_77db0526-9ce6-4899-9e8c-07448e529a34/kube-rbac-proxy/0.log"
Jul 27 17:30:01.258835 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:30:01.258807    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-trb87_5ac14a62-8827-4d06-a67d-2ac290fb0ae7/dns-node-resolver/0.log"
Jul 27 17:30:30.475718 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:30:30.475676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs\") pod \"network-metrics-daemon-h66wv\" (UID: \"5531f102-84da-411c-99df-840e1f4b871a\") " pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:30:30.478039 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:30:30.478009    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5531f102-84da-411c-99df-840e1f4b871a-metrics-certs\") pod \"network-metrics-daemon-h66wv\" (UID: \"5531f102-84da-411c-99df-840e1f4b871a\") " pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:30:30.575506 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:30:30.575477    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jcmcw\""
Jul 27 17:30:30.582850 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:30:30.582829    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h66wv"
Jul 27 17:30:30.707633 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:30:30.707599    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h66wv"]
Jul 27 17:30:30.710797 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:30:30.710771    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5531f102_84da_411c_99df_840e1f4b871a.slice/crio-c11b4c096d8faa24ff587b44ea666faf262566bed64b338d14ee87def97cc392 WatchSource:0}: Error finding container c11b4c096d8faa24ff587b44ea666faf262566bed64b338d14ee87def97cc392: Status 404 returned error can't find the container with id c11b4c096d8faa24ff587b44ea666faf262566bed64b338d14ee87def97cc392
Jul 27 17:30:30.775783 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:30:30.775712    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h66wv" event={"ID":"5531f102-84da-411c-99df-840e1f4b871a","Type":"ContainerStarted","Data":"c11b4c096d8faa24ff587b44ea666faf262566bed64b338d14ee87def97cc392"}
Jul 27 17:30:34.791066 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:30:34.791027    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h66wv" event={"ID":"5531f102-84da-411c-99df-840e1f4b871a","Type":"ContainerStarted","Data":"eb430a00b8df3eec178fe7560dfad51ace702325916fbb4935674a9fe1b72440"}
Jul 27 17:30:34.791483 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:30:34.791080    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h66wv" event={"ID":"5531f102-84da-411c-99df-840e1f4b871a","Type":"ContainerStarted","Data":"75f8f4acdf929838a2fcdb3f15693a374ca72a1c27b9a1e493449fe9780dce8b"}
Jul 27 17:30:34.808746 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:30:34.808700    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h66wv" podStartSLOduration=373.261920402 podStartE2EDuration="6m16.808685251s" totalImagesPullingTime="3.546764849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:30:34.808130534 +0000 UTC m=+377.822796977" watchObservedRunningTime="2026-07-27 17:30:34.808685251 +0000 UTC m=+377.823351694"
Jul 27 17:32:50.453187 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.453146    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-77n6v"]
Jul 27 17:32:50.453745 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.453449    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f" containerName="registry"
Jul 27 17:32:50.453745 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.453463    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f" containerName="registry"
Jul 27 17:32:50.453745 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.453514    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebc75585-b2ae-4110-a2ca-d3b2fbeaab1f" containerName="registry"
Jul 27 17:32:50.456264 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.456249    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-77n6v"
Jul 27 17:32:50.460331 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.460311    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 17:32:50.461425 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.461398    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7b6d9\""
Jul 27 17:32:50.461533 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.461446    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 17:32:50.474108 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.474084    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-77n6v"]
Jul 27 17:32:50.509314 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.509278    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfkcx\" (UniqueName: \"kubernetes.io/projected/2613d58a-d505-4a5e-955c-6c1dc8111f99-kube-api-access-kfkcx\") pod \"cert-manager-cainjector-559cdd8c87-77n6v\" (UID: \"2613d58a-d505-4a5e-955c-6c1dc8111f99\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-77n6v"
Jul 27 17:32:50.509457 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.509339    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2613d58a-d505-4a5e-955c-6c1dc8111f99-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-77n6v\" (UID: \"2613d58a-d505-4a5e-955c-6c1dc8111f99\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-77n6v"
Jul 27 17:32:50.609755 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.609720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfkcx\" (UniqueName: \"kubernetes.io/projected/2613d58a-d505-4a5e-955c-6c1dc8111f99-kube-api-access-kfkcx\") pod \"cert-manager-cainjector-559cdd8c87-77n6v\" (UID: \"2613d58a-d505-4a5e-955c-6c1dc8111f99\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-77n6v"
Jul 27 17:32:50.609895 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.609772    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2613d58a-d505-4a5e-955c-6c1dc8111f99-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-77n6v\" (UID: \"2613d58a-d505-4a5e-955c-6c1dc8111f99\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-77n6v"
Jul 27 17:32:50.620281 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.620245    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2613d58a-d505-4a5e-955c-6c1dc8111f99-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-77n6v\" (UID: \"2613d58a-d505-4a5e-955c-6c1dc8111f99\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-77n6v"
Jul 27 17:32:50.620387 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.620335    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfkcx\" (UniqueName: \"kubernetes.io/projected/2613d58a-d505-4a5e-955c-6c1dc8111f99-kube-api-access-kfkcx\") pod \"cert-manager-cainjector-559cdd8c87-77n6v\" (UID: \"2613d58a-d505-4a5e-955c-6c1dc8111f99\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-77n6v"
Jul 27 17:32:50.764691 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.764599    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-77n6v"
Jul 27 17:32:50.888392 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:50.888357    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-77n6v"]
Jul 27 17:32:50.892037 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:32:50.892008    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2613d58a_d505_4a5e_955c_6c1dc8111f99.slice/crio-60a70dea8e21a371d402691e7c1da90d991e81042295db01227e3bc7aee204b8 WatchSource:0}: Error finding container 60a70dea8e21a371d402691e7c1da90d991e81042295db01227e3bc7aee204b8: Status 404 returned error can't find the container with id 60a70dea8e21a371d402691e7c1da90d991e81042295db01227e3bc7aee204b8
Jul 27 17:32:51.227759 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:51.227725    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-77n6v" event={"ID":"2613d58a-d505-4a5e-955c-6c1dc8111f99","Type":"ContainerStarted","Data":"60a70dea8e21a371d402691e7c1da90d991e81042295db01227e3bc7aee204b8"}
Jul 27 17:32:55.243106 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:55.243068    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-77n6v" event={"ID":"2613d58a-d505-4a5e-955c-6c1dc8111f99","Type":"ContainerStarted","Data":"d0e098bb31a2003956a01238ef639b11535a6280083c29b0cf81a898ff94891c"}
Jul 27 17:32:55.261320 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:32:55.261272    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-77n6v" podStartSLOduration=1.876879537 podStartE2EDuration="5.261256132s" totalImagesPullingTime="3.384376595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:32:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:32:55.260748692 +0000 UTC m=+518.275415135" watchObservedRunningTime="2026-07-27 17:32:55.261256132 +0000 UTC m=+518.275922577"
Jul 27 17:33:00.664567 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:00.664534    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62wjc"]
Jul 27 17:33:00.667648 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:00.667630    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62wjc"
Jul 27 17:33:00.670238 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:00.670204    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 17:33:00.670365 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:00.670282    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:33:00.671334 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:00.671299    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-krhhm\""
Jul 27 17:33:00.675282 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:00.675261    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62wjc"]
Jul 27 17:33:00.787577 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:00.787545    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8hh2\" (UniqueName: \"kubernetes.io/projected/61c34123-c9ee-42c4-a24a-56273753af3c-kube-api-access-f8hh2\") pod \"openshift-lws-operator-fd8ccff4c-62wjc\" (UID: \"61c34123-c9ee-42c4-a24a-56273753af3c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62wjc"
Jul 27 17:33:00.787741 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:00.787606    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61c34123-c9ee-42c4-a24a-56273753af3c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-62wjc\" (UID: \"61c34123-c9ee-42c4-a24a-56273753af3c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62wjc"
Jul 27 17:33:00.888699 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:00.888670    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61c34123-c9ee-42c4-a24a-56273753af3c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-62wjc\" (UID: \"61c34123-c9ee-42c4-a24a-56273753af3c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62wjc"
Jul 27 17:33:00.888806 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:00.888726    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8hh2\" (UniqueName: \"kubernetes.io/projected/61c34123-c9ee-42c4-a24a-56273753af3c-kube-api-access-f8hh2\") pod \"openshift-lws-operator-fd8ccff4c-62wjc\" (UID: \"61c34123-c9ee-42c4-a24a-56273753af3c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62wjc"
Jul 27 17:33:00.889045 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:00.889025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61c34123-c9ee-42c4-a24a-56273753af3c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-62wjc\" (UID: \"61c34123-c9ee-42c4-a24a-56273753af3c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62wjc"
Jul 27 17:33:00.898000 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:00.897953    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8hh2\" (UniqueName: \"kubernetes.io/projected/61c34123-c9ee-42c4-a24a-56273753af3c-kube-api-access-f8hh2\") pod \"openshift-lws-operator-fd8ccff4c-62wjc\" (UID: \"61c34123-c9ee-42c4-a24a-56273753af3c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62wjc"
Jul 27 17:33:00.976883 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:00.976807    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62wjc"
Jul 27 17:33:01.101074 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:01.101050    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62wjc"]
Jul 27 17:33:01.103556 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:33:01.103527    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61c34123_c9ee_42c4_a24a_56273753af3c.slice/crio-d8fd90cd8b84f4c509b6004a3fb399d64a50294a50c9e3a9749a61012e4703bd WatchSource:0}: Error finding container d8fd90cd8b84f4c509b6004a3fb399d64a50294a50c9e3a9749a61012e4703bd: Status 404 returned error can't find the container with id d8fd90cd8b84f4c509b6004a3fb399d64a50294a50c9e3a9749a61012e4703bd
Jul 27 17:33:01.264434 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:01.264344    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62wjc" event={"ID":"61c34123-c9ee-42c4-a24a-56273753af3c","Type":"ContainerStarted","Data":"d8fd90cd8b84f4c509b6004a3fb399d64a50294a50c9e3a9749a61012e4703bd"}
Jul 27 17:33:04.280331 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:04.280295    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62wjc" event={"ID":"61c34123-c9ee-42c4-a24a-56273753af3c","Type":"ContainerStarted","Data":"852256d3ddb8518c607bb6c8de8b671b79d1a733df952147f93c58a320c053f0"}
Jul 27 17:33:04.298371 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:04.298323    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62wjc" podStartSLOduration=1.268512573 podStartE2EDuration="4.298306957s" totalImagesPullingTime="3.029794384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:33:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:33:04.297808259 +0000 UTC m=+527.312474704" watchObservedRunningTime="2026-07-27 17:33:04.298306957 +0000 UTC m=+527.312973405"
Jul 27 17:33:21.975065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:21.975026    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"]
Jul 27 17:33:21.981247 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:21.981224    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:21.989362 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:21.989343    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b9sxj\""
Jul 27 17:33:21.989464 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:21.989422    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 17:33:21.989575 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:21.989561    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 17:33:21.989654 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:21.989598    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 17:33:21.989699 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:21.989656    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 17:33:21.998861 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:21.998841    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"]
Jul 27 17:33:22.040965 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.040936    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4c53353c-916f-48af-af94-cf49ab6c6bdd-manifests\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-2znm4\" (UID: \"4c53353c-916f-48af-af94-cf49ab6c6bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:22.041074 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.040974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c53353c-916f-48af-af94-cf49ab6c6bdd-tmp\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-2znm4\" (UID: \"4c53353c-916f-48af-af94-cf49ab6c6bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:22.041074 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.041002    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4c53353c-916f-48af-af94-cf49ab6c6bdd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-2znm4\" (UID: \"4c53353c-916f-48af-af94-cf49ab6c6bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:22.041074 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.041021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq5z6\" (UniqueName: \"kubernetes.io/projected/4c53353c-916f-48af-af94-cf49ab6c6bdd-kube-api-access-fq5z6\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-2znm4\" (UID: \"4c53353c-916f-48af-af94-cf49ab6c6bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:22.041074 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.041048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c53353c-916f-48af-af94-cf49ab6c6bdd-webhook-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-2znm4\" (UID: \"4c53353c-916f-48af-af94-cf49ab6c6bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:22.141702 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.141669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4c53353c-916f-48af-af94-cf49ab6c6bdd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-2znm4\" (UID: \"4c53353c-916f-48af-af94-cf49ab6c6bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:22.141702 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.141703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq5z6\" (UniqueName: \"kubernetes.io/projected/4c53353c-916f-48af-af94-cf49ab6c6bdd-kube-api-access-fq5z6\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-2znm4\" (UID: \"4c53353c-916f-48af-af94-cf49ab6c6bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:22.141940 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.141732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c53353c-916f-48af-af94-cf49ab6c6bdd-webhook-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-2znm4\" (UID: \"4c53353c-916f-48af-af94-cf49ab6c6bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:22.141940 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.141761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4c53353c-916f-48af-af94-cf49ab6c6bdd-manifests\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-2znm4\" (UID: \"4c53353c-916f-48af-af94-cf49ab6c6bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:22.141940 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.141787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c53353c-916f-48af-af94-cf49ab6c6bdd-tmp\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-2znm4\" (UID: \"4c53353c-916f-48af-af94-cf49ab6c6bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:22.142271 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.142242    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4c53353c-916f-48af-af94-cf49ab6c6bdd-manifests\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-2znm4\" (UID: \"4c53353c-916f-48af-af94-cf49ab6c6bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:22.143840 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.143812    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c53353c-916f-48af-af94-cf49ab6c6bdd-tmp\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-2znm4\" (UID: \"4c53353c-916f-48af-af94-cf49ab6c6bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:22.144091 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.144074    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4c53353c-916f-48af-af94-cf49ab6c6bdd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-2znm4\" (UID: \"4c53353c-916f-48af-af94-cf49ab6c6bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:22.144146 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.144109    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c53353c-916f-48af-af94-cf49ab6c6bdd-webhook-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-2znm4\" (UID: \"4c53353c-916f-48af-af94-cf49ab6c6bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:22.150102 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.150081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq5z6\" (UniqueName: \"kubernetes.io/projected/4c53353c-916f-48af-af94-cf49ab6c6bdd-kube-api-access-fq5z6\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-2znm4\" (UID: \"4c53353c-916f-48af-af94-cf49ab6c6bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:22.291261 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.291178    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:22.424536 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:22.424511    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"]
Jul 27 17:33:22.427224 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:33:22.427197    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c53353c_916f_48af_af94_cf49ab6c6bdd.slice/crio-bef4d28e40d51f02c8e62fe4d9be2f2085bf965c3e9a0759f008148aaba3e94a WatchSource:0}: Error finding container bef4d28e40d51f02c8e62fe4d9be2f2085bf965c3e9a0759f008148aaba3e94a: Status 404 returned error can't find the container with id bef4d28e40d51f02c8e62fe4d9be2f2085bf965c3e9a0759f008148aaba3e94a
Jul 27 17:33:23.345882 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:23.345836    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4" event={"ID":"4c53353c-916f-48af-af94-cf49ab6c6bdd","Type":"ContainerStarted","Data":"bef4d28e40d51f02c8e62fe4d9be2f2085bf965c3e9a0759f008148aaba3e94a"}
Jul 27 17:33:26.367456 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:26.367416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4" event={"ID":"4c53353c-916f-48af-af94-cf49ab6c6bdd","Type":"ContainerStarted","Data":"f2c188acf1390f07c2ce6f24683266a1875da6dc05a7c9d02706b33de355fa3e"}
Jul 27 17:33:27.372453 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:27.372416    2580 generic.go:356] "Generic (PLEG): container finished" podID="4c53353c-916f-48af-af94-cf49ab6c6bdd" containerID="f2c188acf1390f07c2ce6f24683266a1875da6dc05a7c9d02706b33de355fa3e" exitCode=0
Jul 27 17:33:27.372870 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:27.372507    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4" event={"ID":"4c53353c-916f-48af-af94-cf49ab6c6bdd","Type":"ContainerDied","Data":"f2c188acf1390f07c2ce6f24683266a1875da6dc05a7c9d02706b33de355fa3e"}
Jul 27 17:33:28.377743 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:28.377655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4" event={"ID":"4c53353c-916f-48af-af94-cf49ab6c6bdd","Type":"ContainerStarted","Data":"ceec8c632543035c47a00230a4d9abaf0f090656ef7c7c5cafe69d42574b2fc6"}
Jul 27 17:33:28.378111 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:28.377764    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:28.403979 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:28.403935    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4" podStartSLOduration=2.599477835 podStartE2EDuration="7.403921329s" totalImagesPullingTime="3.712851669s" totalInitContainerRuntime="1.091591825s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:33:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:33:28.402619842 +0000 UTC m=+551.417286285" watchObservedRunningTime="2026-07-27 17:33:28.403921329 +0000 UTC m=+551.418587773"
Jul 27 17:33:39.385159 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:39.385123    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-2znm4"
Jul 27 17:33:42.385024 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.384987    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5"]
Jul 27 17:33:42.388028 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.388009    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5"
Jul 27 17:33:42.391724 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.391701    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-86l6p\""
Jul 27 17:33:42.391829 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.391712    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 17:33:42.392028 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.392014    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 17:33:42.392126 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.392113    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 17:33:42.392916 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.392897    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 17:33:42.406444 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.406422    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5"]
Jul 27 17:33:42.491465 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.491439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73b549b6-eb05-4cc4-80b6-768f050e152e-tmp\") pod \"kube-auth-proxy-56bf8956b4-wvls5\" (UID: \"73b549b6-eb05-4cc4-80b6-768f050e152e\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5"
Jul 27 17:33:42.491652 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.491471    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b549b6-eb05-4cc4-80b6-768f050e152e-tls-certs\") pod \"kube-auth-proxy-56bf8956b4-wvls5\" (UID: \"73b549b6-eb05-4cc4-80b6-768f050e152e\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5"
Jul 27 17:33:42.491652 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.491496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lkff\" (UniqueName: \"kubernetes.io/projected/73b549b6-eb05-4cc4-80b6-768f050e152e-kube-api-access-9lkff\") pod \"kube-auth-proxy-56bf8956b4-wvls5\" (UID: \"73b549b6-eb05-4cc4-80b6-768f050e152e\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5"
Jul 27 17:33:42.578871 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.578840    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6z8gb"]
Jul 27 17:33:42.582017 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.581995    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6z8gb"
Jul 27 17:33:42.585005 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.584986    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-sm5z8\""
Jul 27 17:33:42.585700 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.585683    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 27 17:33:42.591887 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.591866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73b549b6-eb05-4cc4-80b6-768f050e152e-tmp\") pod \"kube-auth-proxy-56bf8956b4-wvls5\" (UID: \"73b549b6-eb05-4cc4-80b6-768f050e152e\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5"
Jul 27 17:33:42.591992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.591902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b549b6-eb05-4cc4-80b6-768f050e152e-tls-certs\") pod \"kube-auth-proxy-56bf8956b4-wvls5\" (UID: \"73b549b6-eb05-4cc4-80b6-768f050e152e\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5"
Jul 27 17:33:42.591992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.591940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lkff\" (UniqueName: \"kubernetes.io/projected/73b549b6-eb05-4cc4-80b6-768f050e152e-kube-api-access-9lkff\") pod \"kube-auth-proxy-56bf8956b4-wvls5\" (UID: \"73b549b6-eb05-4cc4-80b6-768f050e152e\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5"
Jul 27 17:33:42.592106 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:33:42.592089    2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 27 17:33:42.592160 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:33:42.592143    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b549b6-eb05-4cc4-80b6-768f050e152e-tls-certs podName:73b549b6-eb05-4cc4-80b6-768f050e152e nodeName:}" failed. No retries permitted until 2026-07-27 17:33:43.092129428 +0000 UTC m=+566.106795854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/73b549b6-eb05-4cc4-80b6-768f050e152e-tls-certs") pod "kube-auth-proxy-56bf8956b4-wvls5" (UID: "73b549b6-eb05-4cc4-80b6-768f050e152e") : secret "kube-auth-proxy-tls" not found
Jul 27 17:33:42.594340 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.594298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73b549b6-eb05-4cc4-80b6-768f050e152e-tmp\") pod \"kube-auth-proxy-56bf8956b4-wvls5\" (UID: \"73b549b6-eb05-4cc4-80b6-768f050e152e\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5"
Jul 27 17:33:42.595168 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.595147    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6z8gb"]
Jul 27 17:33:42.616152 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.616130    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lkff\" (UniqueName: \"kubernetes.io/projected/73b549b6-eb05-4cc4-80b6-768f050e152e-kube-api-access-9lkff\") pod \"kube-auth-proxy-56bf8956b4-wvls5\" (UID: \"73b549b6-eb05-4cc4-80b6-768f050e152e\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5"
Jul 27 17:33:42.692858 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.692835    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfc5ce3e-6266-4acd-8ea0-57150194ac01-cert\") pod \"odh-model-controller-7998c67dc4-6z8gb\" (UID: \"bfc5ce3e-6266-4acd-8ea0-57150194ac01\") " pod="opendatahub/odh-model-controller-7998c67dc4-6z8gb"
Jul 27 17:33:42.692986 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.692883    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn7zq\" (UniqueName: \"kubernetes.io/projected/bfc5ce3e-6266-4acd-8ea0-57150194ac01-kube-api-access-fn7zq\") pod \"odh-model-controller-7998c67dc4-6z8gb\" (UID: \"bfc5ce3e-6266-4acd-8ea0-57150194ac01\") " pod="opendatahub/odh-model-controller-7998c67dc4-6z8gb"
Jul 27 17:33:42.793647 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.793618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfc5ce3e-6266-4acd-8ea0-57150194ac01-cert\") pod \"odh-model-controller-7998c67dc4-6z8gb\" (UID: \"bfc5ce3e-6266-4acd-8ea0-57150194ac01\") " pod="opendatahub/odh-model-controller-7998c67dc4-6z8gb"
Jul 27 17:33:42.793790 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.793668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn7zq\" (UniqueName: \"kubernetes.io/projected/bfc5ce3e-6266-4acd-8ea0-57150194ac01-kube-api-access-fn7zq\") pod \"odh-model-controller-7998c67dc4-6z8gb\" (UID: \"bfc5ce3e-6266-4acd-8ea0-57150194ac01\") " pod="opendatahub/odh-model-controller-7998c67dc4-6z8gb"
Jul 27 17:33:42.796003 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.795976    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfc5ce3e-6266-4acd-8ea0-57150194ac01-cert\") pod \"odh-model-controller-7998c67dc4-6z8gb\" (UID: \"bfc5ce3e-6266-4acd-8ea0-57150194ac01\") " pod="opendatahub/odh-model-controller-7998c67dc4-6z8gb"
Jul 27 17:33:42.806853 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.806829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn7zq\" (UniqueName: \"kubernetes.io/projected/bfc5ce3e-6266-4acd-8ea0-57150194ac01-kube-api-access-fn7zq\") pod \"odh-model-controller-7998c67dc4-6z8gb\" (UID: \"bfc5ce3e-6266-4acd-8ea0-57150194ac01\") " pod="opendatahub/odh-model-controller-7998c67dc4-6z8gb"
Jul 27 17:33:42.892198 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:42.892163    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6z8gb"
Jul 27 17:33:43.019837 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.019806    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6z8gb"]
Jul 27 17:33:43.023504 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:33:43.023472    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc5ce3e_6266_4acd_8ea0_57150194ac01.slice/crio-29432f8139b0a8a32328459605d4463cae38b18ef31c04208ded19818b2dc9f8 WatchSource:0}: Error finding container 29432f8139b0a8a32328459605d4463cae38b18ef31c04208ded19818b2dc9f8: Status 404 returned error can't find the container with id 29432f8139b0a8a32328459605d4463cae38b18ef31c04208ded19818b2dc9f8
Jul 27 17:33:43.095840 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.095810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b549b6-eb05-4cc4-80b6-768f050e152e-tls-certs\") pod \"kube-auth-proxy-56bf8956b4-wvls5\" (UID: \"73b549b6-eb05-4cc4-80b6-768f050e152e\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5"
Jul 27 17:33:43.098242 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.098219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73b549b6-eb05-4cc4-80b6-768f050e152e-tls-certs\") pod \"kube-auth-proxy-56bf8956b4-wvls5\" (UID: \"73b549b6-eb05-4cc4-80b6-768f050e152e\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5"
Jul 27 17:33:43.297024 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.296931    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5"
Jul 27 17:33:43.427435 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.427407    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5"]
Jul 27 17:33:43.430185 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.430149    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6z8gb" event={"ID":"bfc5ce3e-6266-4acd-8ea0-57150194ac01","Type":"ContainerStarted","Data":"29432f8139b0a8a32328459605d4463cae38b18ef31c04208ded19818b2dc9f8"}
Jul 27 17:33:43.430304 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:33:43.430242    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b549b6_eb05_4cc4_80b6_768f050e152e.slice/crio-84ee1621d506f746fe9b1101a58424a44505e7b5ba308ec55eb14746104125c1 WatchSource:0}: Error finding container 84ee1621d506f746fe9b1101a58424a44505e7b5ba308ec55eb14746104125c1: Status 404 returned error can't find the container with id 84ee1621d506f746fe9b1101a58424a44505e7b5ba308ec55eb14746104125c1
Jul 27 17:33:43.564790 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.564720    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x7wnf"]
Jul 27 17:33:43.568861 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.568843    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-x7wnf"
Jul 27 17:33:43.571442 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.571426    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 27 17:33:43.571519 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.571426    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-kx767\""
Jul 27 17:33:43.580910 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.580111    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x7wnf"]
Jul 27 17:33:43.700237 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.700196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1d16e92-e371-4f4b-9b1b-586d0fb20540-tls-certs\") pod \"model-serving-api-54d89bd5fc-x7wnf\" (UID: \"c1d16e92-e371-4f4b-9b1b-586d0fb20540\") " pod="opendatahub/model-serving-api-54d89bd5fc-x7wnf"
Jul 27 17:33:43.700397 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.700286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvzbm\" (UniqueName: \"kubernetes.io/projected/c1d16e92-e371-4f4b-9b1b-586d0fb20540-kube-api-access-tvzbm\") pod \"model-serving-api-54d89bd5fc-x7wnf\" (UID: \"c1d16e92-e371-4f4b-9b1b-586d0fb20540\") " pod="opendatahub/model-serving-api-54d89bd5fc-x7wnf"
Jul 27 17:33:43.717093 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.717061    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"]
Jul 27 17:33:43.720262 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.720243    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.725881 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.725795    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 17:33:43.726722 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.726485    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mpt8w\""
Jul 27 17:33:43.726862 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.726838    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 17:33:43.727146 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.726977    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 17:33:43.727146 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.727087    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 17:33:43.733914 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.733889    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"]
Jul 27 17:33:43.801364 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.801332    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.801510 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.801371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvzbm\" (UniqueName: \"kubernetes.io/projected/c1d16e92-e371-4f4b-9b1b-586d0fb20540-kube-api-access-tvzbm\") pod \"model-serving-api-54d89bd5fc-x7wnf\" (UID: \"c1d16e92-e371-4f4b-9b1b-586d0fb20540\") " pod="opendatahub/model-serving-api-54d89bd5fc-x7wnf"
Jul 27 17:33:43.801510 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.801404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.801510 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.801446    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1d16e92-e371-4f4b-9b1b-586d0fb20540-tls-certs\") pod \"model-serving-api-54d89bd5fc-x7wnf\" (UID: \"c1d16e92-e371-4f4b-9b1b-586d0fb20540\") " pod="opendatahub/model-serving-api-54d89bd5fc-x7wnf"
Jul 27 17:33:43.801510 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.801465    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.801510 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.801490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.801510 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.801515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c307cff1-7a74-4f8e-9313-213c10741b9d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.801510 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.801533    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.801942 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.801601    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdmgc\" (UniqueName: \"kubernetes.io/projected/c307cff1-7a74-4f8e-9313-213c10741b9d-kube-api-access-bdmgc\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.803969 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.803946    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1d16e92-e371-4f4b-9b1b-586d0fb20540-tls-certs\") pod \"model-serving-api-54d89bd5fc-x7wnf\" (UID: \"c1d16e92-e371-4f4b-9b1b-586d0fb20540\") " pod="opendatahub/model-serving-api-54d89bd5fc-x7wnf"
Jul 27 17:33:43.810690 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.810667    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvzbm\" (UniqueName: \"kubernetes.io/projected/c1d16e92-e371-4f4b-9b1b-586d0fb20540-kube-api-access-tvzbm\") pod \"model-serving-api-54d89bd5fc-x7wnf\" (UID: \"c1d16e92-e371-4f4b-9b1b-586d0fb20540\") " pod="opendatahub/model-serving-api-54d89bd5fc-x7wnf"
Jul 27 17:33:43.881461 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.881326    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-x7wnf"
Jul 27 17:33:43.903186 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.903144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.903353 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.903213    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdmgc\" (UniqueName: \"kubernetes.io/projected/c307cff1-7a74-4f8e-9313-213c10741b9d-kube-api-access-bdmgc\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.903353 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.903267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.903353 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.903298    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.903532 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.903359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.903532 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.903384    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.903532 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.903413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c307cff1-7a74-4f8e-9313-213c10741b9d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.905359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.905300    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.906972 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.906925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c307cff1-7a74-4f8e-9313-213c10741b9d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.907410 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.907369    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.908940 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.908896    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.909200 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.908959    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.914381 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.914333    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:43.915615 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:43.915543    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdmgc\" (UniqueName: \"kubernetes.io/projected/c307cff1-7a74-4f8e-9313-213c10741b9d-kube-api-access-bdmgc\") pod \"istiod-openshift-gateway-7b7995d5cd-lwpcl\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:44.031506 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:44.031361    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:44.045098 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:44.045071    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x7wnf"]
Jul 27 17:33:44.049244 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:33:44.049220    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d16e92_e371_4f4b_9b1b_586d0fb20540.slice/crio-6dd3e60fca3c1ecfd4507be2d36830af1bba603a1e94070a43fd475eae5a2ea0 WatchSource:0}: Error finding container 6dd3e60fca3c1ecfd4507be2d36830af1bba603a1e94070a43fd475eae5a2ea0: Status 404 returned error can't find the container with id 6dd3e60fca3c1ecfd4507be2d36830af1bba603a1e94070a43fd475eae5a2ea0
Jul 27 17:33:44.181359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:44.181319    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"]
Jul 27 17:33:44.185307 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:33:44.185278    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc307cff1_7a74_4f8e_9313_213c10741b9d.slice/crio-49a445c9fd50248bf7d5341e785bf7c6c02e304cda8ba6e34821932782251e15 WatchSource:0}: Error finding container 49a445c9fd50248bf7d5341e785bf7c6c02e304cda8ba6e34821932782251e15: Status 404 returned error can't find the container with id 49a445c9fd50248bf7d5341e785bf7c6c02e304cda8ba6e34821932782251e15
Jul 27 17:33:44.437247 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:44.437160    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-x7wnf" event={"ID":"c1d16e92-e371-4f4b-9b1b-586d0fb20540","Type":"ContainerStarted","Data":"6dd3e60fca3c1ecfd4507be2d36830af1bba603a1e94070a43fd475eae5a2ea0"}
Jul 27 17:33:44.439084 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:44.439017    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl" event={"ID":"c307cff1-7a74-4f8e-9313-213c10741b9d","Type":"ContainerStarted","Data":"49a445c9fd50248bf7d5341e785bf7c6c02e304cda8ba6e34821932782251e15"}
Jul 27 17:33:44.440503 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:44.440451    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5" event={"ID":"73b549b6-eb05-4cc4-80b6-768f050e152e","Type":"ContainerStarted","Data":"84ee1621d506f746fe9b1101a58424a44505e7b5ba308ec55eb14746104125c1"}
Jul 27 17:33:47.458542 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:47.458501    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-x7wnf" event={"ID":"c1d16e92-e371-4f4b-9b1b-586d0fb20540","Type":"ContainerStarted","Data":"c9c7ec29ff3b4040fbf08029040f89eae5c76968964fffb14fcb41857a480912"}
Jul 27 17:33:47.459052 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:47.458605    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-x7wnf"
Jul 27 17:33:47.460759 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:47.460731    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5" event={"ID":"73b549b6-eb05-4cc4-80b6-768f050e152e","Type":"ContainerStarted","Data":"5cfde1f51c48c7c3fff995c241d59c8e0f08047155f5e1465892b7e11f3359c0"}
Jul 27 17:33:47.462368 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:47.462343    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6z8gb" event={"ID":"bfc5ce3e-6266-4acd-8ea0-57150194ac01","Type":"ContainerStarted","Data":"9cb1da641336e99d7f52cc0147e0f9a7399e6785e5ba4bd864f57344e30aad64"}
Jul 27 17:33:47.462519 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:47.462490    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-6z8gb"
Jul 27 17:33:47.477943 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:47.477886    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-x7wnf" podStartSLOduration=1.231007951 podStartE2EDuration="4.477870621s" totalImagesPullingTime="3.24686267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:33:47.476881445 +0000 UTC m=+570.491547890" watchObservedRunningTime="2026-07-27 17:33:47.477870621 +0000 UTC m=+570.492537066"
Jul 27 17:33:47.498678 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:47.498310    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-6z8gb" podStartSLOduration=1.228332171 podStartE2EDuration="5.498293391s" totalImagesPullingTime="4.26996122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:33:47.497991313 +0000 UTC m=+570.512657759" watchObservedRunningTime="2026-07-27 17:33:47.498293391 +0000 UTC m=+570.512959839"
Jul 27 17:33:47.519111 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:47.519049    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-56bf8956b4-wvls5" podStartSLOduration=1.6530317110000001 podStartE2EDuration="5.519032021s" totalImagesPullingTime="3.86600031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:33:47.518898833 +0000 UTC m=+570.533565278" watchObservedRunningTime="2026-07-27 17:33:47.519032021 +0000 UTC m=+570.533698466"
Jul 27 17:33:48.636632 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:48.636565    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:33:48.637007 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:48.636672    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:33:49.475110 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:49.475061    2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-lwpcl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 17:33:49.475319 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:49.475150    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl" podUID="c307cff1-7a74-4f8e-9313-213c10741b9d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 17:33:49.477860 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:49.477836    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:49.477981 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:49.477892    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl" event={"ID":"c307cff1-7a74-4f8e-9313-213c10741b9d","Type":"ContainerStarted","Data":"5e49934c91d4e64b14d957276c764e7a8d7a13858932246688c9bfb8565d30c1"}
Jul 27 17:33:49.497838 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:49.497791    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl" podStartSLOduration=2.04965109 podStartE2EDuration="6.497777166s" totalImagesPullingTime="4.448126076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:33:49.495849981 +0000 UTC m=+572.510516423" watchObservedRunningTime="2026-07-27 17:33:49.497777166 +0000 UTC m=+572.512443609"
Jul 27 17:33:50.184400 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.184360    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"]
Jul 27 17:33:50.187804 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.187787    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.192388 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.192366    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wz2lb\""
Jul 27 17:33:50.213435 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.213409    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"]
Jul 27 17:33:50.361130 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.361091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b16284d6-9e6f-461e-8430-006b7c253bd1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.361286 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.361135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhdtj\" (UniqueName: \"kubernetes.io/projected/b16284d6-9e6f-461e-8430-006b7c253bd1-kube-api-access-dhdtj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.361286 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.361210    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b16284d6-9e6f-461e-8430-006b7c253bd1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.361411 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.361305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b16284d6-9e6f-461e-8430-006b7c253bd1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.361411 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.361394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b16284d6-9e6f-461e-8430-006b7c253bd1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.361513 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.361467    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b16284d6-9e6f-461e-8430-006b7c253bd1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.361568 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.361515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b16284d6-9e6f-461e-8430-006b7c253bd1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.361648 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.361572    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b16284d6-9e6f-461e-8430-006b7c253bd1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.361648 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.361626    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b16284d6-9e6f-461e-8430-006b7c253bd1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.462960 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.462878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b16284d6-9e6f-461e-8430-006b7c253bd1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.462960 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.462938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b16284d6-9e6f-461e-8430-006b7c253bd1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.463175 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.462966    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b16284d6-9e6f-461e-8430-006b7c253bd1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.463175 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.462997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b16284d6-9e6f-461e-8430-006b7c253bd1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.463175 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.463016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b16284d6-9e6f-461e-8430-006b7c253bd1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.463175 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.463033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b16284d6-9e6f-461e-8430-006b7c253bd1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.463175 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.463061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b16284d6-9e6f-461e-8430-006b7c253bd1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.463175 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.463091    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b16284d6-9e6f-461e-8430-006b7c253bd1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.463175 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.463116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhdtj\" (UniqueName: \"kubernetes.io/projected/b16284d6-9e6f-461e-8430-006b7c253bd1-kube-api-access-dhdtj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.463514 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.463457    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b16284d6-9e6f-461e-8430-006b7c253bd1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.463514 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.463487    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b16284d6-9e6f-461e-8430-006b7c253bd1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.463704 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.463682    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b16284d6-9e6f-461e-8430-006b7c253bd1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.463782 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.463764    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b16284d6-9e6f-461e-8430-006b7c253bd1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.463913 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.463893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b16284d6-9e6f-461e-8430-006b7c253bd1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.465493 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.465476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b16284d6-9e6f-461e-8430-006b7c253bd1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.465611 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.465569    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b16284d6-9e6f-461e-8430-006b7c253bd1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.476693 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.476667    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b16284d6-9e6f-461e-8430-006b7c253bd1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.479131 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.479105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhdtj\" (UniqueName: \"kubernetes.io/projected/b16284d6-9e6f-461e-8430-006b7c253bd1-kube-api-access-dhdtj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn\" (UID: \"b16284d6-9e6f-461e-8430-006b7c253bd1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.479535 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.479510    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:50.496896 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.496876    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:50.638831 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:50.638671    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"]
Jul 27 17:33:50.641199 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:33:50.641166    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb16284d6_9e6f_461e_8430_006b7c253bd1.slice/crio-32221b20f6915bebf748b75ea4551595f0afb3cf9186e9e344108c67104075fd WatchSource:0}: Error finding container 32221b20f6915bebf748b75ea4551595f0afb3cf9186e9e344108c67104075fd: Status 404 returned error can't find the container with id 32221b20f6915bebf748b75ea4551595f0afb3cf9186e9e344108c67104075fd
Jul 27 17:33:51.483715 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:51.483679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn" event={"ID":"b16284d6-9e6f-461e-8430-006b7c253bd1","Type":"ContainerStarted","Data":"32221b20f6915bebf748b75ea4551595f0afb3cf9186e9e344108c67104075fd"}
Jul 27 17:33:52.707132 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.707097    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk"]
Jul 27 17:33:52.713542 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.713518    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk"
Jul 27 17:33:52.716992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.716929    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 27 17:33:52.717155 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.717130    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-p26dr\""
Jul 27 17:33:52.728957 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.728930    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk"]
Jul 27 17:33:52.732786 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.732762    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2sf2p"]
Jul 27 17:33:52.736545 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.736522    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sf2p"
Jul 27 17:33:52.739933 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.739902    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 27 17:33:52.740049 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.739933    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-ttjbz\""
Jul 27 17:33:52.750550 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.750523    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2sf2p"]
Jul 27 17:33:52.884217 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.884183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg2cr\" (UniqueName: \"kubernetes.io/projected/a638af53-8c4c-4760-9821-22d6e4c3e56f-kube-api-access-cg2cr\") pod \"kserve-controller-manager-d6f4b65b8-bb8dk\" (UID: \"a638af53-8c4c-4760-9821-22d6e4c3e56f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk"
Jul 27 17:33:52.884394 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.884259    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6da74151-7b7b-4e5a-8912-837e512929bf-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2sf2p\" (UID: \"6da74151-7b7b-4e5a-8912-837e512929bf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sf2p"
Jul 27 17:33:52.884394 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.884305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktftb\" (UniqueName: \"kubernetes.io/projected/6da74151-7b7b-4e5a-8912-837e512929bf-kube-api-access-ktftb\") pod \"llmisvc-controller-manager-777c6bd7d5-2sf2p\" (UID: \"6da74151-7b7b-4e5a-8912-837e512929bf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sf2p"
Jul 27 17:33:52.884394 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.884368    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a638af53-8c4c-4760-9821-22d6e4c3e56f-cert\") pod \"kserve-controller-manager-d6f4b65b8-bb8dk\" (UID: \"a638af53-8c4c-4760-9821-22d6e4c3e56f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk"
Jul 27 17:33:52.985680 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.985565    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg2cr\" (UniqueName: \"kubernetes.io/projected/a638af53-8c4c-4760-9821-22d6e4c3e56f-kube-api-access-cg2cr\") pod \"kserve-controller-manager-d6f4b65b8-bb8dk\" (UID: \"a638af53-8c4c-4760-9821-22d6e4c3e56f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk"
Jul 27 17:33:52.985680 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.985667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6da74151-7b7b-4e5a-8912-837e512929bf-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2sf2p\" (UID: \"6da74151-7b7b-4e5a-8912-837e512929bf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sf2p"
Jul 27 17:33:52.985910 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.985723    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktftb\" (UniqueName: \"kubernetes.io/projected/6da74151-7b7b-4e5a-8912-837e512929bf-kube-api-access-ktftb\") pod \"llmisvc-controller-manager-777c6bd7d5-2sf2p\" (UID: \"6da74151-7b7b-4e5a-8912-837e512929bf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sf2p"
Jul 27 17:33:52.985910 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.985752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a638af53-8c4c-4760-9821-22d6e4c3e56f-cert\") pod \"kserve-controller-manager-d6f4b65b8-bb8dk\" (UID: \"a638af53-8c4c-4760-9821-22d6e4c3e56f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk"
Jul 27 17:33:52.985910 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:33:52.985869    2580 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 27 17:33:52.986073 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:33:52.985955    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a638af53-8c4c-4760-9821-22d6e4c3e56f-cert podName:a638af53-8c4c-4760-9821-22d6e4c3e56f nodeName:}" failed. No retries permitted until 2026-07-27 17:33:53.485933612 +0000 UTC m=+576.500600037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a638af53-8c4c-4760-9821-22d6e4c3e56f-cert") pod "kserve-controller-manager-d6f4b65b8-bb8dk" (UID: "a638af53-8c4c-4760-9821-22d6e4c3e56f") : secret "kserve-webhook-server-cert" not found
Jul 27 17:33:52.988523 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.988490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6da74151-7b7b-4e5a-8912-837e512929bf-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2sf2p\" (UID: \"6da74151-7b7b-4e5a-8912-837e512929bf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sf2p"
Jul 27 17:33:52.998040 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:52.998017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg2cr\" (UniqueName: \"kubernetes.io/projected/a638af53-8c4c-4760-9821-22d6e4c3e56f-kube-api-access-cg2cr\") pod \"kserve-controller-manager-d6f4b65b8-bb8dk\" (UID: \"a638af53-8c4c-4760-9821-22d6e4c3e56f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk"
Jul 27 17:33:53.000519 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:53.000498    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktftb\" (UniqueName: \"kubernetes.io/projected/6da74151-7b7b-4e5a-8912-837e512929bf-kube-api-access-ktftb\") pod \"llmisvc-controller-manager-777c6bd7d5-2sf2p\" (UID: \"6da74151-7b7b-4e5a-8912-837e512929bf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sf2p"
Jul 27 17:33:53.050086 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:53.050059    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sf2p"
Jul 27 17:33:53.489817 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:53.489782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a638af53-8c4c-4760-9821-22d6e4c3e56f-cert\") pod \"kserve-controller-manager-d6f4b65b8-bb8dk\" (UID: \"a638af53-8c4c-4760-9821-22d6e4c3e56f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk"
Jul 27 17:33:53.492502 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:53.492477    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a638af53-8c4c-4760-9821-22d6e4c3e56f-cert\") pod \"kserve-controller-manager-d6f4b65b8-bb8dk\" (UID: \"a638af53-8c4c-4760-9821-22d6e4c3e56f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk"
Jul 27 17:33:53.627505 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:53.627457    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk"
Jul 27 17:33:53.715561 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:53.713025    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:33:53.715561 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:53.713118    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:33:53.715561 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:53.713160    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:33:53.805759 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:33:53.805729    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6da74151_7b7b_4e5a_8912_837e512929bf.slice/crio-23781936a2869b853e0172a3cfd7dfe05ed1a9229d5b6cb44fa6d8563f75a975 WatchSource:0}: Error finding container 23781936a2869b853e0172a3cfd7dfe05ed1a9229d5b6cb44fa6d8563f75a975: Status 404 returned error can't find the container with id 23781936a2869b853e0172a3cfd7dfe05ed1a9229d5b6cb44fa6d8563f75a975
Jul 27 17:33:53.806144 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:53.806126    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2sf2p"]
Jul 27 17:33:53.822600 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:53.822556    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk"]
Jul 27 17:33:53.825548 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:33:53.825519    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda638af53_8c4c_4760_9821_22d6e4c3e56f.slice/crio-945ef3bebc2862ad2246197538d700342b031a6e03ed4382267526e21e493f49 WatchSource:0}: Error finding container 945ef3bebc2862ad2246197538d700342b031a6e03ed4382267526e21e493f49: Status 404 returned error can't find the container with id 945ef3bebc2862ad2246197538d700342b031a6e03ed4382267526e21e493f49
Jul 27 17:33:54.497173 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:54.497136    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn" event={"ID":"b16284d6-9e6f-461e-8430-006b7c253bd1","Type":"ContainerStarted","Data":"3e7544d7c41bb53bf6fb4e4dba24f84246d18cbf255eafa3f909fb38fa1ba3fb"}
Jul 27 17:33:54.498383 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:54.498353    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk" event={"ID":"a638af53-8c4c-4760-9821-22d6e4c3e56f","Type":"ContainerStarted","Data":"945ef3bebc2862ad2246197538d700342b031a6e03ed4382267526e21e493f49"}
Jul 27 17:33:54.499427 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:54.499404    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sf2p" event={"ID":"6da74151-7b7b-4e5a-8912-837e512929bf","Type":"ContainerStarted","Data":"23781936a2869b853e0172a3cfd7dfe05ed1a9229d5b6cb44fa6d8563f75a975"}
Jul 27 17:33:54.518703 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:54.518658    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn" podStartSLOduration=1.449109186 podStartE2EDuration="4.51864339s" totalImagesPullingTime="3.069534204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:33:54.51850928 +0000 UTC m=+577.533175726" watchObservedRunningTime="2026-07-27 17:33:54.51864339 +0000 UTC m=+577.533309899"
Jul 27 17:33:55.498019 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:55.497938    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:55.503747 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:55.503660    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:55.505590 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:55.505552    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:55.506753 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:55.506731    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn"
Jul 27 17:33:55.803032 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:55.802184    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"]
Jul 27 17:33:55.803032 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:55.802455    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl" podUID="c307cff1-7a74-4f8e-9313-213c10741b9d" containerName="discovery" containerID="cri-o://5e49934c91d4e64b14d957276c764e7a8d7a13858932246688c9bfb8565d30c1" gracePeriod=30
Jul 27 17:33:56.157815 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.157788    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:56.315973 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.315892    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c307cff1-7a74-4f8e-9313-213c10741b9d-local-certs\") pod \"c307cff1-7a74-4f8e-9313-213c10741b9d\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") "
Jul 27 17:33:56.316139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.315986    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdmgc\" (UniqueName: \"kubernetes.io/projected/c307cff1-7a74-4f8e-9313-213c10741b9d-kube-api-access-bdmgc\") pod \"c307cff1-7a74-4f8e-9313-213c10741b9d\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") "
Jul 27 17:33:56.316139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.316032    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-cacerts\") pod \"c307cff1-7a74-4f8e-9313-213c10741b9d\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") "
Jul 27 17:33:56.316139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.316074    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-token\") pod \"c307cff1-7a74-4f8e-9313-213c10741b9d\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") "
Jul 27 17:33:56.316139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.316110    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-kubeconfig\") pod \"c307cff1-7a74-4f8e-9313-213c10741b9d\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") "
Jul 27 17:33:56.316343 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.316174    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-csr-ca-configmap\") pod \"c307cff1-7a74-4f8e-9313-213c10741b9d\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") "
Jul 27 17:33:56.316343 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.316201    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-csr-dns-cert\") pod \"c307cff1-7a74-4f8e-9313-213c10741b9d\" (UID: \"c307cff1-7a74-4f8e-9313-213c10741b9d\") "
Jul 27 17:33:56.316861 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.316659    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c307cff1-7a74-4f8e-9313-213c10741b9d" (UID: "c307cff1-7a74-4f8e-9313-213c10741b9d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:33:56.318989 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.318960    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c307cff1-7a74-4f8e-9313-213c10741b9d" (UID: "c307cff1-7a74-4f8e-9313-213c10741b9d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:33:56.319116 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.319035    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c307cff1-7a74-4f8e-9313-213c10741b9d" (UID: "c307cff1-7a74-4f8e-9313-213c10741b9d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:33:56.319116 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.319041    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c307cff1-7a74-4f8e-9313-213c10741b9d-kube-api-access-bdmgc" (OuterVolumeSpecName: "kube-api-access-bdmgc") pod "c307cff1-7a74-4f8e-9313-213c10741b9d" (UID: "c307cff1-7a74-4f8e-9313-213c10741b9d"). InnerVolumeSpecName "kube-api-access-bdmgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:33:56.319225 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.319170    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-cacerts" (OuterVolumeSpecName: "cacerts") pod "c307cff1-7a74-4f8e-9313-213c10741b9d" (UID: "c307cff1-7a74-4f8e-9313-213c10741b9d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:33:56.319297 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.319267    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-token" (OuterVolumeSpecName: "istio-token") pod "c307cff1-7a74-4f8e-9313-213c10741b9d" (UID: "c307cff1-7a74-4f8e-9313-213c10741b9d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:33:56.320390 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.320358    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c307cff1-7a74-4f8e-9313-213c10741b9d-local-certs" (OuterVolumeSpecName: "local-certs") pod "c307cff1-7a74-4f8e-9313-213c10741b9d" (UID: "c307cff1-7a74-4f8e-9313-213c10741b9d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:33:56.417074 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.417033    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:33:56.417074 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.417071    2580 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-kubeconfig\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:33:56.417280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.417085    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-csr-ca-configmap\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:33:56.417280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.417099    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-istio-csr-dns-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:33:56.417280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.417112    2580 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c307cff1-7a74-4f8e-9313-213c10741b9d-local-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:33:56.417280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.417120    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdmgc\" (UniqueName: \"kubernetes.io/projected/c307cff1-7a74-4f8e-9313-213c10741b9d-kube-api-access-bdmgc\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:33:56.417280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.417128    2580 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c307cff1-7a74-4f8e-9313-213c10741b9d-cacerts\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:33:56.511336 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.511296    2580 generic.go:356] "Generic (PLEG): container finished" podID="c307cff1-7a74-4f8e-9313-213c10741b9d" containerID="5e49934c91d4e64b14d957276c764e7a8d7a13858932246688c9bfb8565d30c1" exitCode=0
Jul 27 17:33:56.511780 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.511351    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"
Jul 27 17:33:56.511780 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.511381    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl" event={"ID":"c307cff1-7a74-4f8e-9313-213c10741b9d","Type":"ContainerDied","Data":"5e49934c91d4e64b14d957276c764e7a8d7a13858932246688c9bfb8565d30c1"}
Jul 27 17:33:56.511780 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.511452    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl" event={"ID":"c307cff1-7a74-4f8e-9313-213c10741b9d","Type":"ContainerDied","Data":"49a445c9fd50248bf7d5341e785bf7c6c02e304cda8ba6e34821932782251e15"}
Jul 27 17:33:56.511780 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.511484    2580 scope.go:117] "RemoveContainer" containerID="5e49934c91d4e64b14d957276c764e7a8d7a13858932246688c9bfb8565d30c1"
Jul 27 17:33:56.537431 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.537404    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"]
Jul 27 17:33:56.541366 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:56.541346    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwpcl"]
Jul 27 17:33:57.476543 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:57.476512    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c307cff1-7a74-4f8e-9313-213c10741b9d" path="/var/lib/kubelet/pods/c307cff1-7a74-4f8e-9313-213c10741b9d/volumes"
Jul 27 17:33:57.526066 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:57.525743    2580 scope.go:117] "RemoveContainer" containerID="5e49934c91d4e64b14d957276c764e7a8d7a13858932246688c9bfb8565d30c1"
Jul 27 17:33:57.526066 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:33:57.526019    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e49934c91d4e64b14d957276c764e7a8d7a13858932246688c9bfb8565d30c1\": container with ID starting with 5e49934c91d4e64b14d957276c764e7a8d7a13858932246688c9bfb8565d30c1 not found: ID does not exist" containerID="5e49934c91d4e64b14d957276c764e7a8d7a13858932246688c9bfb8565d30c1"
Jul 27 17:33:57.526066 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:57.526045    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e49934c91d4e64b14d957276c764e7a8d7a13858932246688c9bfb8565d30c1"} err="failed to get container status \"5e49934c91d4e64b14d957276c764e7a8d7a13858932246688c9bfb8565d30c1\": rpc error: code = NotFound desc = could not find container \"5e49934c91d4e64b14d957276c764e7a8d7a13858932246688c9bfb8565d30c1\": container with ID starting with 5e49934c91d4e64b14d957276c764e7a8d7a13858932246688c9bfb8565d30c1 not found: ID does not exist"
Jul 27 17:33:58.468946 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:58.468916    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-6z8gb"
Jul 27 17:33:58.470755 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:58.470734    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-x7wnf"
Jul 27 17:33:58.525261 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:58.525133    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk" event={"ID":"a638af53-8c4c-4760-9821-22d6e4c3e56f","Type":"ContainerStarted","Data":"b79e917774f4792182b8c17ccb2e75e54b958256c58cb8282dbcd4cb5bf50d62"}
Jul 27 17:33:58.525434 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:58.525266    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk"
Jul 27 17:33:58.526947 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:58.526922    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sf2p" event={"ID":"6da74151-7b7b-4e5a-8912-837e512929bf","Type":"ContainerStarted","Data":"4a941e15ded258634a50c1fdf4d4f94e01e554051a25cd7f22c53fbdac9b9f7d"}
Jul 27 17:33:58.527333 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:58.526969    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sf2p"
Jul 27 17:33:58.543961 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:58.543908    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk" podStartSLOduration=2.837185713 podStartE2EDuration="6.543889308s" totalImagesPullingTime="3.706703595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:33:58.542726397 +0000 UTC m=+581.557392847" watchObservedRunningTime="2026-07-27 17:33:58.543889308 +0000 UTC m=+581.558555755"
Jul 27 17:33:58.563293 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:33:58.563246    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sf2p" podStartSLOduration=2.832323004 podStartE2EDuration="6.563228785s" totalImagesPullingTime="3.730905781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:33:58.561627786 +0000 UTC m=+581.576294232" watchObservedRunningTime="2026-07-27 17:33:58.563228785 +0000 UTC m=+581.577895230"
Jul 27 17:34:29.533736 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:29.533695    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sf2p"
Jul 27 17:34:29.546465 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:29.536609    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bb8dk"
Jul 27 17:34:43.242210 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.242127    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jxm4w"]
Jul 27 17:34:43.242564 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.242428    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c307cff1-7a74-4f8e-9313-213c10741b9d" containerName="discovery"
Jul 27 17:34:43.242564 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.242440    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c307cff1-7a74-4f8e-9313-213c10741b9d" containerName="discovery"
Jul 27 17:34:43.242564 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.242492    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c307cff1-7a74-4f8e-9313-213c10741b9d" containerName="discovery"
Jul 27 17:34:43.245357 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.245339    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jxm4w"
Jul 27 17:34:43.248038 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.248018    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 17:34:43.248159 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.248124    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 17:34:43.248242 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.248228    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gk66w\""
Jul 27 17:34:43.255323 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.255302    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jxm4w"]
Jul 27 17:34:43.366228 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.366188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkbwl\" (UniqueName: \"kubernetes.io/projected/a11721a4-2727-49c0-83ca-4d286b38da7e-kube-api-access-tkbwl\") pod \"kuadrant-operator-catalog-jxm4w\" (UID: \"a11721a4-2727-49c0-83ca-4d286b38da7e\") " pod="kuadrant-system/kuadrant-operator-catalog-jxm4w"
Jul 27 17:34:43.466884 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.466844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkbwl\" (UniqueName: \"kubernetes.io/projected/a11721a4-2727-49c0-83ca-4d286b38da7e-kube-api-access-tkbwl\") pod \"kuadrant-operator-catalog-jxm4w\" (UID: \"a11721a4-2727-49c0-83ca-4d286b38da7e\") " pod="kuadrant-system/kuadrant-operator-catalog-jxm4w"
Jul 27 17:34:43.480825 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.480796    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkbwl\" (UniqueName: \"kubernetes.io/projected/a11721a4-2727-49c0-83ca-4d286b38da7e-kube-api-access-tkbwl\") pod \"kuadrant-operator-catalog-jxm4w\" (UID: \"a11721a4-2727-49c0-83ca-4d286b38da7e\") " pod="kuadrant-system/kuadrant-operator-catalog-jxm4w"
Jul 27 17:34:43.554439 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.554351    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jxm4w"
Jul 27 17:34:43.605413 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.605370    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jxm4w"]
Jul 27 17:34:43.681598 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.681545    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jxm4w"]
Jul 27 17:34:43.684705 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:34:43.684673    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda11721a4_2727_49c0_83ca_4d286b38da7e.slice/crio-69ef5ae06e4e63ed664245033cbb142859d0575aba98ad614137e0bdef9f4dbc WatchSource:0}: Error finding container 69ef5ae06e4e63ed664245033cbb142859d0575aba98ad614137e0bdef9f4dbc: Status 404 returned error can't find the container with id 69ef5ae06e4e63ed664245033cbb142859d0575aba98ad614137e0bdef9f4dbc
Jul 27 17:34:43.686402 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.686384    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:34:43.709259 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.709227    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jxm4w" event={"ID":"a11721a4-2727-49c0-83ca-4d286b38da7e","Type":"ContainerStarted","Data":"69ef5ae06e4e63ed664245033cbb142859d0575aba98ad614137e0bdef9f4dbc"}
Jul 27 17:34:43.811568 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.811482    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8sbv6"]
Jul 27 17:34:43.815800 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.815784    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8sbv6"
Jul 27 17:34:43.821495 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.821462    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8sbv6"]
Jul 27 17:34:43.971320 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:43.971284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wssq\" (UniqueName: \"kubernetes.io/projected/3f56d623-3f90-4b0a-8d06-56a27e980ce5-kube-api-access-8wssq\") pod \"kuadrant-operator-catalog-8sbv6\" (UID: \"3f56d623-3f90-4b0a-8d06-56a27e980ce5\") " pod="kuadrant-system/kuadrant-operator-catalog-8sbv6"
Jul 27 17:34:44.072377 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:44.072293    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wssq\" (UniqueName: \"kubernetes.io/projected/3f56d623-3f90-4b0a-8d06-56a27e980ce5-kube-api-access-8wssq\") pod \"kuadrant-operator-catalog-8sbv6\" (UID: \"3f56d623-3f90-4b0a-8d06-56a27e980ce5\") " pod="kuadrant-system/kuadrant-operator-catalog-8sbv6"
Jul 27 17:34:44.081949 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:44.081919    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wssq\" (UniqueName: \"kubernetes.io/projected/3f56d623-3f90-4b0a-8d06-56a27e980ce5-kube-api-access-8wssq\") pod \"kuadrant-operator-catalog-8sbv6\" (UID: \"3f56d623-3f90-4b0a-8d06-56a27e980ce5\") " pod="kuadrant-system/kuadrant-operator-catalog-8sbv6"
Jul 27 17:34:44.125591 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:44.125556    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8sbv6"
Jul 27 17:34:44.255229 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:44.255167    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8sbv6"]
Jul 27 17:34:44.257328 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:34:44.257299    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f56d623_3f90_4b0a_8d06_56a27e980ce5.slice/crio-e047b84302e7dbcc93a9f677390c1ba5acbe8815184e0405dec8f641e361a996 WatchSource:0}: Error finding container e047b84302e7dbcc93a9f677390c1ba5acbe8815184e0405dec8f641e361a996: Status 404 returned error can't find the container with id e047b84302e7dbcc93a9f677390c1ba5acbe8815184e0405dec8f641e361a996
Jul 27 17:34:44.714424 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:44.714393    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8sbv6" event={"ID":"3f56d623-3f90-4b0a-8d06-56a27e980ce5","Type":"ContainerStarted","Data":"e047b84302e7dbcc93a9f677390c1ba5acbe8815184e0405dec8f641e361a996"}
Jul 27 17:34:46.725389 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:46.725341    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jxm4w" event={"ID":"a11721a4-2727-49c0-83ca-4d286b38da7e","Type":"ContainerStarted","Data":"21ea1df951f7686593531655ea5f5982c2f0d3c70161dbb7ac16dc857217c34a"}
Jul 27 17:34:46.725845 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:46.725397    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-jxm4w" podUID="a11721a4-2727-49c0-83ca-4d286b38da7e" containerName="registry-server" containerID="cri-o://21ea1df951f7686593531655ea5f5982c2f0d3c70161dbb7ac16dc857217c34a" gracePeriod=2
Jul 27 17:34:46.726913 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:46.726888    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8sbv6" event={"ID":"3f56d623-3f90-4b0a-8d06-56a27e980ce5","Type":"ContainerStarted","Data":"268ebbb10effb5bc49c4208d4197883389b944b0f2dbf754a7958b034bfb64b0"}
Jul 27 17:34:46.744390 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:46.744347    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jxm4w" podStartSLOduration=1.13232805 podStartE2EDuration="3.744330222s" totalImagesPullingTime="2.612002172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:34:46.74289777 +0000 UTC m=+629.757564213" watchObservedRunningTime="2026-07-27 17:34:46.744330222 +0000 UTC m=+629.758996665"
Jul 27 17:34:46.764773 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:46.764726    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8sbv6" podStartSLOduration=1.7287361300000001 podStartE2EDuration="3.764712369s" totalImagesPullingTime="2.035976239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:34:46.763627758 +0000 UTC m=+629.778294204" watchObservedRunningTime="2026-07-27 17:34:46.764712369 +0000 UTC m=+629.779378817"
Jul 27 17:34:46.963969 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:46.963945    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jxm4w"
Jul 27 17:34:47.100550 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:47.100468    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkbwl\" (UniqueName: \"kubernetes.io/projected/a11721a4-2727-49c0-83ca-4d286b38da7e-kube-api-access-tkbwl\") pod \"a11721a4-2727-49c0-83ca-4d286b38da7e\" (UID: \"a11721a4-2727-49c0-83ca-4d286b38da7e\") "
Jul 27 17:34:47.102638 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:47.102608    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a11721a4-2727-49c0-83ca-4d286b38da7e-kube-api-access-tkbwl" (OuterVolumeSpecName: "kube-api-access-tkbwl") pod "a11721a4-2727-49c0-83ca-4d286b38da7e" (UID: "a11721a4-2727-49c0-83ca-4d286b38da7e"). InnerVolumeSpecName "kube-api-access-tkbwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:34:47.201964 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:47.201922    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkbwl\" (UniqueName: \"kubernetes.io/projected/a11721a4-2727-49c0-83ca-4d286b38da7e-kube-api-access-tkbwl\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:34:47.732056 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:47.732016    2580 generic.go:356] "Generic (PLEG): container finished" podID="a11721a4-2727-49c0-83ca-4d286b38da7e" containerID="21ea1df951f7686593531655ea5f5982c2f0d3c70161dbb7ac16dc857217c34a" exitCode=0
Jul 27 17:34:47.732479 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:47.732066    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jxm4w"
Jul 27 17:34:47.732479 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:47.732065    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jxm4w" event={"ID":"a11721a4-2727-49c0-83ca-4d286b38da7e","Type":"ContainerDied","Data":"21ea1df951f7686593531655ea5f5982c2f0d3c70161dbb7ac16dc857217c34a"}
Jul 27 17:34:47.732479 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:47.732193    2580 scope.go:117] "RemoveContainer" containerID="21ea1df951f7686593531655ea5f5982c2f0d3c70161dbb7ac16dc857217c34a"
Jul 27 17:34:47.732655 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:47.732523    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jxm4w" event={"ID":"a11721a4-2727-49c0-83ca-4d286b38da7e","Type":"ContainerDied","Data":"69ef5ae06e4e63ed664245033cbb142859d0575aba98ad614137e0bdef9f4dbc"}
Jul 27 17:34:47.746346 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:47.746325    2580 scope.go:117] "RemoveContainer" containerID="21ea1df951f7686593531655ea5f5982c2f0d3c70161dbb7ac16dc857217c34a"
Jul 27 17:34:47.746592 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:34:47.746562    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21ea1df951f7686593531655ea5f5982c2f0d3c70161dbb7ac16dc857217c34a\": container with ID starting with 21ea1df951f7686593531655ea5f5982c2f0d3c70161dbb7ac16dc857217c34a not found: ID does not exist" containerID="21ea1df951f7686593531655ea5f5982c2f0d3c70161dbb7ac16dc857217c34a"
Jul 27 17:34:47.746645 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:47.746608    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21ea1df951f7686593531655ea5f5982c2f0d3c70161dbb7ac16dc857217c34a"} err="failed to get container status \"21ea1df951f7686593531655ea5f5982c2f0d3c70161dbb7ac16dc857217c34a\": rpc error: code = NotFound desc = could not find container \"21ea1df951f7686593531655ea5f5982c2f0d3c70161dbb7ac16dc857217c34a\": container with ID starting with 21ea1df951f7686593531655ea5f5982c2f0d3c70161dbb7ac16dc857217c34a not found: ID does not exist"
Jul 27 17:34:47.752996 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:47.752974    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jxm4w"]
Jul 27 17:34:47.754969 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:47.754944    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jxm4w"]
Jul 27 17:34:49.475237 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:49.475204    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a11721a4-2727-49c0-83ca-4d286b38da7e" path="/var/lib/kubelet/pods/a11721a4-2727-49c0-83ca-4d286b38da7e/volumes"
Jul 27 17:34:54.125852 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:54.125814    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8sbv6"
Jul 27 17:34:54.126264 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:54.125900    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8sbv6"
Jul 27 17:34:54.147144 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:54.147121    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8sbv6"
Jul 27 17:34:54.781917 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:34:54.781887    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8sbv6"
Jul 27 17:35:17.879259 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:17.879182    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"]
Jul 27 17:35:17.879668 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:17.879493    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a11721a4-2727-49c0-83ca-4d286b38da7e" containerName="registry-server"
Jul 27 17:35:17.879668 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:17.879505    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a11721a4-2727-49c0-83ca-4d286b38da7e" containerName="registry-server"
Jul 27 17:35:17.879668 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:17.879569    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a11721a4-2727-49c0-83ca-4d286b38da7e" containerName="registry-server"
Jul 27 17:35:17.886010 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:17.885990    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:17.888815 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:17.888797    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6fv9v\""
Jul 27 17:35:17.893443 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:17.893421    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"]
Jul 27 17:35:17.940601 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:17.940548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0496c7c2-0d73-4597-8535-cf4c6a304cbf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44grj\" (UID: \"0496c7c2-0d73-4597-8535-cf4c6a304cbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:17.940734 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:17.940657    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p7w2\" (UniqueName: \"kubernetes.io/projected/0496c7c2-0d73-4597-8535-cf4c6a304cbf-kube-api-access-2p7w2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44grj\" (UID: \"0496c7c2-0d73-4597-8535-cf4c6a304cbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:18.041610 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:18.041560    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p7w2\" (UniqueName: \"kubernetes.io/projected/0496c7c2-0d73-4597-8535-cf4c6a304cbf-kube-api-access-2p7w2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44grj\" (UID: \"0496c7c2-0d73-4597-8535-cf4c6a304cbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:18.041748 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:18.041648    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0496c7c2-0d73-4597-8535-cf4c6a304cbf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44grj\" (UID: \"0496c7c2-0d73-4597-8535-cf4c6a304cbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:18.041970 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:18.041956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0496c7c2-0d73-4597-8535-cf4c6a304cbf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44grj\" (UID: \"0496c7c2-0d73-4597-8535-cf4c6a304cbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:18.053339 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:18.053318    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p7w2\" (UniqueName: \"kubernetes.io/projected/0496c7c2-0d73-4597-8535-cf4c6a304cbf-kube-api-access-2p7w2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44grj\" (UID: \"0496c7c2-0d73-4597-8535-cf4c6a304cbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:18.196244 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:18.196214    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:18.330985 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:18.330949    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"]
Jul 27 17:35:18.334871 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:35:18.334843    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0496c7c2_0d73_4597_8535_cf4c6a304cbf.slice/crio-cd93d9848b3f6b046acdc6967011643c11a1ce2a1c6fc74435fea507346f456c WatchSource:0}: Error finding container cd93d9848b3f6b046acdc6967011643c11a1ce2a1c6fc74435fea507346f456c: Status 404 returned error can't find the container with id cd93d9848b3f6b046acdc6967011643c11a1ce2a1c6fc74435fea507346f456c
Jul 27 17:35:18.857120 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:18.857085    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj" event={"ID":"0496c7c2-0d73-4597-8535-cf4c6a304cbf","Type":"ContainerStarted","Data":"cd93d9848b3f6b046acdc6967011643c11a1ce2a1c6fc74435fea507346f456c"}
Jul 27 17:35:19.835436 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:19.835399    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"]
Jul 27 17:35:19.839148 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:19.839110    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"
Jul 27 17:35:19.841986 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:19.841960    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-g82df\""
Jul 27 17:35:19.851109 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:19.851084    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"]
Jul 27 17:35:19.854425 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:19.854394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l67zt\" (UniqueName: \"kubernetes.io/projected/cb3d9d78-b539-4b83-aa31-2512cc06f5f7-kube-api-access-l67zt\") pod \"limitador-operator-controller-manager-859d7b78bd-ft9c6\" (UID: \"cb3d9d78-b539-4b83-aa31-2512cc06f5f7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"
Jul 27 17:35:19.955254 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:19.955224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l67zt\" (UniqueName: \"kubernetes.io/projected/cb3d9d78-b539-4b83-aa31-2512cc06f5f7-kube-api-access-l67zt\") pod \"limitador-operator-controller-manager-859d7b78bd-ft9c6\" (UID: \"cb3d9d78-b539-4b83-aa31-2512cc06f5f7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"
Jul 27 17:35:19.966877 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:19.966852    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l67zt\" (UniqueName: \"kubernetes.io/projected/cb3d9d78-b539-4b83-aa31-2512cc06f5f7-kube-api-access-l67zt\") pod \"limitador-operator-controller-manager-859d7b78bd-ft9c6\" (UID: \"cb3d9d78-b539-4b83-aa31-2512cc06f5f7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"
Jul 27 17:35:20.151900 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:20.151819    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"
Jul 27 17:35:20.279689 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:20.279650    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"]
Jul 27 17:35:20.283373 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:35:20.283278    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3d9d78_b539_4b83_aa31_2512cc06f5f7.slice/crio-388ca37fed2e4309ddd4e202d83f77df8ea56bf913d3dcd93a00dad5fe3a1cc4 WatchSource:0}: Error finding container 388ca37fed2e4309ddd4e202d83f77df8ea56bf913d3dcd93a00dad5fe3a1cc4: Status 404 returned error can't find the container with id 388ca37fed2e4309ddd4e202d83f77df8ea56bf913d3dcd93a00dad5fe3a1cc4
Jul 27 17:35:20.868275 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:20.868239    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6" event={"ID":"cb3d9d78-b539-4b83-aa31-2512cc06f5f7","Type":"ContainerStarted","Data":"388ca37fed2e4309ddd4e202d83f77df8ea56bf913d3dcd93a00dad5fe3a1cc4"}
Jul 27 17:35:22.879253 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:22.879216    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6" event={"ID":"cb3d9d78-b539-4b83-aa31-2512cc06f5f7","Type":"ContainerStarted","Data":"803052a86fcdca7c69ce56ddce6687ed87787978cdd3dabb5f96b0940555cfe5"}
Jul 27 17:35:22.879720 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:22.879284    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"
Jul 27 17:35:22.898064 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:22.898017    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6" podStartSLOduration=2.1441886549999998 podStartE2EDuration="3.898000774s" totalImagesPullingTime="1.753812119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:35:22.897770682 +0000 UTC m=+665.912437126" watchObservedRunningTime="2026-07-27 17:35:22.898000774 +0000 UTC m=+665.912667218"
Jul 27 17:35:25.897292 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:25.897260    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj" event={"ID":"0496c7c2-0d73-4597-8535-cf4c6a304cbf","Type":"ContainerStarted","Data":"f3b53294ff7477f03074df0e1478e795eb01732bc428507a9f1e545c9207c099"}
Jul 27 17:35:25.897773 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:25.897417    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:25.921496 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:25.921435    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj" podStartSLOduration=2.440045523 podStartE2EDuration="8.921413391s" totalImagesPullingTime="6.481367868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:35:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:35:25.918712406 +0000 UTC m=+668.933378847" watchObservedRunningTime="2026-07-27 17:35:25.921413391 +0000 UTC m=+668.936079837"
Jul 27 17:35:26.258884 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:26.258827    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xptg5"]
Jul 27 17:35:26.262243 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:26.262225    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xptg5"
Jul 27 17:35:26.265055 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:26.265028    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-p7t7b\""
Jul 27 17:35:26.265055 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:26.265026    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 27 17:35:26.271713 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:26.271692    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xptg5"]
Jul 27 17:35:26.312088 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:26.312055    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlc6s\" (UniqueName: \"kubernetes.io/projected/f1cf9b47-046a-4231-a3a0-cbaa930d87d5-kube-api-access-dlc6s\") pod \"dns-operator-controller-manager-864dd78c4c-xptg5\" (UID: \"f1cf9b47-046a-4231-a3a0-cbaa930d87d5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xptg5"
Jul 27 17:35:26.412769 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:26.412719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlc6s\" (UniqueName: \"kubernetes.io/projected/f1cf9b47-046a-4231-a3a0-cbaa930d87d5-kube-api-access-dlc6s\") pod \"dns-operator-controller-manager-864dd78c4c-xptg5\" (UID: \"f1cf9b47-046a-4231-a3a0-cbaa930d87d5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xptg5"
Jul 27 17:35:26.425152 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:26.425126    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlc6s\" (UniqueName: \"kubernetes.io/projected/f1cf9b47-046a-4231-a3a0-cbaa930d87d5-kube-api-access-dlc6s\") pod \"dns-operator-controller-manager-864dd78c4c-xptg5\" (UID: \"f1cf9b47-046a-4231-a3a0-cbaa930d87d5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xptg5"
Jul 27 17:35:26.572991 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:26.572905    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xptg5"
Jul 27 17:35:26.707721 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:26.707686    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xptg5"]
Jul 27 17:35:26.711759 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:35:26.711731    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1cf9b47_046a_4231_a3a0_cbaa930d87d5.slice/crio-8402a154eb1d11a0f56c9ad32c7b2ef676768292200bf7d34c6a08947240df76 WatchSource:0}: Error finding container 8402a154eb1d11a0f56c9ad32c7b2ef676768292200bf7d34c6a08947240df76: Status 404 returned error can't find the container with id 8402a154eb1d11a0f56c9ad32c7b2ef676768292200bf7d34c6a08947240df76
Jul 27 17:35:26.902518 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:26.902426    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xptg5" event={"ID":"f1cf9b47-046a-4231-a3a0-cbaa930d87d5","Type":"ContainerStarted","Data":"8402a154eb1d11a0f56c9ad32c7b2ef676768292200bf7d34c6a08947240df76"}
Jul 27 17:35:27.630222 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:27.630190    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st"]
Jul 27 17:35:27.634040 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:27.634017    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st"
Jul 27 17:35:27.639856 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:27.639806    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 27 17:35:27.640073 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:27.639881    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-js8m8\""
Jul 27 17:35:27.640918 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:27.640890    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 27 17:35:27.642322 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:27.642297    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st"]
Jul 27 17:35:27.732561 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:27.732520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7cbc\" (UniqueName: \"kubernetes.io/projected/68965fea-6a9f-418e-b0eb-0b5cb406e670-kube-api-access-q7cbc\") pod \"kuadrant-console-plugin-66b5774985-zv6st\" (UID: \"68965fea-6a9f-418e-b0eb-0b5cb406e670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st"
Jul 27 17:35:27.732767 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:27.732575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/68965fea-6a9f-418e-b0eb-0b5cb406e670-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zv6st\" (UID: \"68965fea-6a9f-418e-b0eb-0b5cb406e670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st"
Jul 27 17:35:27.732767 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:27.732686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/68965fea-6a9f-418e-b0eb-0b5cb406e670-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zv6st\" (UID: \"68965fea-6a9f-418e-b0eb-0b5cb406e670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st"
Jul 27 17:35:27.833207 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:27.833170    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7cbc\" (UniqueName: \"kubernetes.io/projected/68965fea-6a9f-418e-b0eb-0b5cb406e670-kube-api-access-q7cbc\") pod \"kuadrant-console-plugin-66b5774985-zv6st\" (UID: \"68965fea-6a9f-418e-b0eb-0b5cb406e670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st"
Jul 27 17:35:27.833207 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:27.833215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/68965fea-6a9f-418e-b0eb-0b5cb406e670-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zv6st\" (UID: \"68965fea-6a9f-418e-b0eb-0b5cb406e670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st"
Jul 27 17:35:27.833499 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:27.833243    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/68965fea-6a9f-418e-b0eb-0b5cb406e670-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zv6st\" (UID: \"68965fea-6a9f-418e-b0eb-0b5cb406e670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st"
Jul 27 17:35:27.833499 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:35:27.833371    2580 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 27 17:35:27.833499 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:35:27.833457    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68965fea-6a9f-418e-b0eb-0b5cb406e670-plugin-serving-cert podName:68965fea-6a9f-418e-b0eb-0b5cb406e670 nodeName:}" failed. No retries permitted until 2026-07-27 17:35:28.333434065 +0000 UTC m=+671.348100492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/68965fea-6a9f-418e-b0eb-0b5cb406e670-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-zv6st" (UID: "68965fea-6a9f-418e-b0eb-0b5cb406e670") : secret "plugin-serving-cert" not found
Jul 27 17:35:27.833993 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:27.833970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/68965fea-6a9f-418e-b0eb-0b5cb406e670-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zv6st\" (UID: \"68965fea-6a9f-418e-b0eb-0b5cb406e670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st"
Jul 27 17:35:27.842518 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:27.842493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7cbc\" (UniqueName: \"kubernetes.io/projected/68965fea-6a9f-418e-b0eb-0b5cb406e670-kube-api-access-q7cbc\") pod \"kuadrant-console-plugin-66b5774985-zv6st\" (UID: \"68965fea-6a9f-418e-b0eb-0b5cb406e670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st"
Jul 27 17:35:28.336063 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:28.336017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/68965fea-6a9f-418e-b0eb-0b5cb406e670-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zv6st\" (UID: \"68965fea-6a9f-418e-b0eb-0b5cb406e670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st"
Jul 27 17:35:28.338428 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:28.338392    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/68965fea-6a9f-418e-b0eb-0b5cb406e670-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zv6st\" (UID: \"68965fea-6a9f-418e-b0eb-0b5cb406e670\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st"
Jul 27 17:35:28.544831 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:28.544795    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st"
Jul 27 17:35:28.693637 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:28.693600    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st"]
Jul 27 17:35:28.695855 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:35:28.695826    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68965fea_6a9f_418e_b0eb_0b5cb406e670.slice/crio-da836907ff579e336a1b9f30ad04af3fd3af8543af714ee2f2191d3a8ac62018 WatchSource:0}: Error finding container da836907ff579e336a1b9f30ad04af3fd3af8543af714ee2f2191d3a8ac62018: Status 404 returned error can't find the container with id da836907ff579e336a1b9f30ad04af3fd3af8543af714ee2f2191d3a8ac62018
Jul 27 17:35:28.918348 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:28.918303    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st" event={"ID":"68965fea-6a9f-418e-b0eb-0b5cb406e670","Type":"ContainerStarted","Data":"da836907ff579e336a1b9f30ad04af3fd3af8543af714ee2f2191d3a8ac62018"}
Jul 27 17:35:29.924149 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:29.924111    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xptg5" event={"ID":"f1cf9b47-046a-4231-a3a0-cbaa930d87d5","Type":"ContainerStarted","Data":"bcb0f3da288d6dcbf41e43feb96c4ab705970790314dd8167884cd08f1571ad8"}
Jul 27 17:35:29.924510 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:29.924217    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xptg5"
Jul 27 17:35:29.943148 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:29.943091    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xptg5" podStartSLOduration=1.523648631 podStartE2EDuration="3.943072677s" totalImagesPullingTime="2.419424046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:35:29.942722175 +0000 UTC m=+672.957388621" watchObservedRunningTime="2026-07-27 17:35:29.943072677 +0000 UTC m=+672.957739121"
Jul 27 17:35:33.888156 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:33.888120    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"
Jul 27 17:35:36.905875 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:36.905844    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:38.662337 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.662300    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"]
Jul 27 17:35:38.662817 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.662604    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj" podUID="0496c7c2-0d73-4597-8535-cf4c6a304cbf" containerName="manager" containerID="cri-o://f3b53294ff7477f03074df0e1478e795eb01732bc428507a9f1e545c9207c099" gracePeriod=2
Jul 27 17:35:38.668499 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.668471    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"]
Jul 27 17:35:38.685074 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.685050    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"]
Jul 27 17:35:38.685321 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.685268    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6" podUID="cb3d9d78-b539-4b83-aa31-2512cc06f5f7" containerName="manager" containerID="cri-o://803052a86fcdca7c69ce56ddce6687ed87787978cdd3dabb5f96b0940555cfe5" gracePeriod=2
Jul 27 17:35:38.693107 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:35:38.692239    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-44grj\" is forbidden: User \"system:node:ip-10-0-131-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-200.ec2.internal' and this object" podUID="0496c7c2-0d73-4597-8535-cf4c6a304cbf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:38.694800 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.694738    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"]
Jul 27 17:35:38.724403 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.724355    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"]
Jul 27 17:35:38.724777 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.724758    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb3d9d78-b539-4b83-aa31-2512cc06f5f7" containerName="manager"
Jul 27 17:35:38.724777 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.724779    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb3d9d78-b539-4b83-aa31-2512cc06f5f7" containerName="manager"
Jul 27 17:35:38.724931 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.724798    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0496c7c2-0d73-4597-8535-cf4c6a304cbf" containerName="manager"
Jul 27 17:35:38.724931 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.724806    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0496c7c2-0d73-4597-8535-cf4c6a304cbf" containerName="manager"
Jul 27 17:35:38.724931 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.724894    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb3d9d78-b539-4b83-aa31-2512cc06f5f7" containerName="manager"
Jul 27 17:35:38.724931 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.724905    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0496c7c2-0d73-4597-8535-cf4c6a304cbf" containerName="manager"
Jul 27 17:35:38.728308 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.728281    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"
Jul 27 17:35:38.731128 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:35:38.731094    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ft9c6\" is forbidden: User \"system:node:ip-10-0-131-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-200.ec2.internal' and this object" podUID="cb3d9d78-b539-4b83-aa31-2512cc06f5f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"
Jul 27 17:35:38.743076 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.743050    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69ncf"]
Jul 27 17:35:38.748054 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.748003    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"]
Jul 27 17:35:38.748173 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.748099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69ncf"
Jul 27 17:35:38.760429 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.760400    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69ncf"]
Jul 27 17:35:38.777112 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:35:38.777070    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-44grj\" is forbidden: User \"system:node:ip-10-0-131-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-200.ec2.internal' and this object" podUID="0496c7c2-0d73-4597-8535-cf4c6a304cbf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:38.782120 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:35:38.782092    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ft9c6\" is forbidden: User \"system:node:ip-10-0-131-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-200.ec2.internal' and this object" podUID="cb3d9d78-b539-4b83-aa31-2512cc06f5f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"
Jul 27 17:35:38.785652 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:35:38.785625    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-44grj\" is forbidden: User \"system:node:ip-10-0-131-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-200.ec2.internal' and this object" podUID="0496c7c2-0d73-4597-8535-cf4c6a304cbf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:38.831185 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.831152    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3f01e94-2a34-4dbb-9568-775452e4918d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5xlxw\" (UID: \"e3f01e94-2a34-4dbb-9568-775452e4918d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"
Jul 27 17:35:38.831327 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.831199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9279\" (UniqueName: \"kubernetes.io/projected/455dcde8-ecea-4a34-91d6-212e2cff79d9-kube-api-access-z9279\") pod \"limitador-operator-controller-manager-859d7b78bd-69ncf\" (UID: \"455dcde8-ecea-4a34-91d6-212e2cff79d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69ncf"
Jul 27 17:35:38.831327 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.831299    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m44tq\" (UniqueName: \"kubernetes.io/projected/e3f01e94-2a34-4dbb-9568-775452e4918d-kube-api-access-m44tq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5xlxw\" (UID: \"e3f01e94-2a34-4dbb-9568-775452e4918d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"
Jul 27 17:35:38.932036 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.931939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3f01e94-2a34-4dbb-9568-775452e4918d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5xlxw\" (UID: \"e3f01e94-2a34-4dbb-9568-775452e4918d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"
Jul 27 17:35:38.932036 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.931996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9279\" (UniqueName: \"kubernetes.io/projected/455dcde8-ecea-4a34-91d6-212e2cff79d9-kube-api-access-z9279\") pod \"limitador-operator-controller-manager-859d7b78bd-69ncf\" (UID: \"455dcde8-ecea-4a34-91d6-212e2cff79d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69ncf"
Jul 27 17:35:38.932321 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.932051    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m44tq\" (UniqueName: \"kubernetes.io/projected/e3f01e94-2a34-4dbb-9568-775452e4918d-kube-api-access-m44tq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5xlxw\" (UID: \"e3f01e94-2a34-4dbb-9568-775452e4918d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"
Jul 27 17:35:38.932461 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.932423    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3f01e94-2a34-4dbb-9568-775452e4918d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5xlxw\" (UID: \"e3f01e94-2a34-4dbb-9568-775452e4918d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"
Jul 27 17:35:38.944615 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.944572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9279\" (UniqueName: \"kubernetes.io/projected/455dcde8-ecea-4a34-91d6-212e2cff79d9-kube-api-access-z9279\") pod \"limitador-operator-controller-manager-859d7b78bd-69ncf\" (UID: \"455dcde8-ecea-4a34-91d6-212e2cff79d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69ncf"
Jul 27 17:35:38.944722 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:38.944615    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m44tq\" (UniqueName: \"kubernetes.io/projected/e3f01e94-2a34-4dbb-9568-775452e4918d-kube-api-access-m44tq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5xlxw\" (UID: \"e3f01e94-2a34-4dbb-9568-775452e4918d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"
Jul 27 17:35:39.088092 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:39.088058    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"
Jul 27 17:35:39.095529 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:39.095488    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69ncf"
Jul 27 17:35:40.931662 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:40.931629    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xptg5"
Jul 27 17:35:51.041349 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.040749    2580 generic.go:356] "Generic (PLEG): container finished" podID="0496c7c2-0d73-4597-8535-cf4c6a304cbf" containerID="f3b53294ff7477f03074df0e1478e795eb01732bc428507a9f1e545c9207c099" exitCode=0
Jul 27 17:35:51.053007 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.052877    2580 generic.go:356] "Generic (PLEG): container finished" podID="cb3d9d78-b539-4b83-aa31-2512cc06f5f7" containerID="803052a86fcdca7c69ce56ddce6687ed87787978cdd3dabb5f96b0940555cfe5" exitCode=0
Jul 27 17:35:51.102154 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.100261    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"
Jul 27 17:35:51.104875 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.104847    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:51.105830 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:35:51.105795    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ft9c6\" is forbidden: User \"system:node:ip-10-0-131-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-200.ec2.internal' and this object" podUID="cb3d9d78-b539-4b83-aa31-2512cc06f5f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"
Jul 27 17:35:51.113636 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:35:51.113604    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ft9c6\" is forbidden: User \"system:node:ip-10-0-131-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-200.ec2.internal' and this object" podUID="cb3d9d78-b539-4b83-aa31-2512cc06f5f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"
Jul 27 17:35:51.116240 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:35:51.116201    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-44grj\" is forbidden: User \"system:node:ip-10-0-131-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-200.ec2.internal' and this object" podUID="0496c7c2-0d73-4597-8535-cf4c6a304cbf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:51.152358 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.152336    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"]
Jul 27 17:35:51.153537 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:35:51.153504    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f01e94_2a34_4dbb_9568_775452e4918d.slice/crio-321c99cd22a9be6f5f6408b57cb09246c3e717fc2fa070733cc7e4b184ebae21 WatchSource:0}: Error finding container 321c99cd22a9be6f5f6408b57cb09246c3e717fc2fa070733cc7e4b184ebae21: Status 404 returned error can't find the container with id 321c99cd22a9be6f5f6408b57cb09246c3e717fc2fa070733cc7e4b184ebae21
Jul 27 17:35:51.176568 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.176541    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69ncf"]
Jul 27 17:35:51.181752 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:35:51.181728    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod455dcde8_ecea_4a34_91d6_212e2cff79d9.slice/crio-5bd5826ceb03ee1f31ec455ca424b6b24c4ba469cbd943495556bdde404b29ae WatchSource:0}: Error finding container 5bd5826ceb03ee1f31ec455ca424b6b24c4ba469cbd943495556bdde404b29ae: Status 404 returned error can't find the container with id 5bd5826ceb03ee1f31ec455ca424b6b24c4ba469cbd943495556bdde404b29ae
Jul 27 17:35:51.243207 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.243174    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l67zt\" (UniqueName: \"kubernetes.io/projected/cb3d9d78-b539-4b83-aa31-2512cc06f5f7-kube-api-access-l67zt\") pod \"cb3d9d78-b539-4b83-aa31-2512cc06f5f7\" (UID: \"cb3d9d78-b539-4b83-aa31-2512cc06f5f7\") "
Jul 27 17:35:51.243331 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.243238    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p7w2\" (UniqueName: \"kubernetes.io/projected/0496c7c2-0d73-4597-8535-cf4c6a304cbf-kube-api-access-2p7w2\") pod \"0496c7c2-0d73-4597-8535-cf4c6a304cbf\" (UID: \"0496c7c2-0d73-4597-8535-cf4c6a304cbf\") "
Jul 27 17:35:51.243331 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.243325    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0496c7c2-0d73-4597-8535-cf4c6a304cbf-extensions-socket-volume\") pod \"0496c7c2-0d73-4597-8535-cf4c6a304cbf\" (UID: \"0496c7c2-0d73-4597-8535-cf4c6a304cbf\") "
Jul 27 17:35:51.244072 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.244030    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0496c7c2-0d73-4597-8535-cf4c6a304cbf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0496c7c2-0d73-4597-8535-cf4c6a304cbf" (UID: "0496c7c2-0d73-4597-8535-cf4c6a304cbf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:35:51.245242 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.245219    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0496c7c2-0d73-4597-8535-cf4c6a304cbf-kube-api-access-2p7w2" (OuterVolumeSpecName: "kube-api-access-2p7w2") pod "0496c7c2-0d73-4597-8535-cf4c6a304cbf" (UID: "0496c7c2-0d73-4597-8535-cf4c6a304cbf"). InnerVolumeSpecName "kube-api-access-2p7w2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:35:51.245337 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.245214    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb3d9d78-b539-4b83-aa31-2512cc06f5f7-kube-api-access-l67zt" (OuterVolumeSpecName: "kube-api-access-l67zt") pod "cb3d9d78-b539-4b83-aa31-2512cc06f5f7" (UID: "cb3d9d78-b539-4b83-aa31-2512cc06f5f7"). InnerVolumeSpecName "kube-api-access-l67zt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:35:51.344401 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.344366    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l67zt\" (UniqueName: \"kubernetes.io/projected/cb3d9d78-b539-4b83-aa31-2512cc06f5f7-kube-api-access-l67zt\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:35:51.344401 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.344398    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p7w2\" (UniqueName: \"kubernetes.io/projected/0496c7c2-0d73-4597-8535-cf4c6a304cbf-kube-api-access-2p7w2\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:35:51.344401 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.344408    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0496c7c2-0d73-4597-8535-cf4c6a304cbf-extensions-socket-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:35:51.476833 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.476738    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0496c7c2-0d73-4597-8535-cf4c6a304cbf" path="/var/lib/kubelet/pods/0496c7c2-0d73-4597-8535-cf4c6a304cbf/volumes"
Jul 27 17:35:51.477198 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:51.477175    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb3d9d78-b539-4b83-aa31-2512cc06f5f7" path="/var/lib/kubelet/pods/cb3d9d78-b539-4b83-aa31-2512cc06f5f7/volumes"
Jul 27 17:35:52.059244 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:52.059204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st" event={"ID":"68965fea-6a9f-418e-b0eb-0b5cb406e670","Type":"ContainerStarted","Data":"9e64270b5e96f17d91d4900f6a8b1636a3f630ec95e0758a3d21133c5035cf23"}
Jul 27 17:35:52.060906 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:52.060872    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw" event={"ID":"e3f01e94-2a34-4dbb-9568-775452e4918d","Type":"ContainerStarted","Data":"330810959b92e3c207748d3602385c4715be3b4d0fce1af31afbad8db8ccb81f"}
Jul 27 17:35:52.061032 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:52.060929    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw" event={"ID":"e3f01e94-2a34-4dbb-9568-775452e4918d","Type":"ContainerStarted","Data":"321c99cd22a9be6f5f6408b57cb09246c3e717fc2fa070733cc7e4b184ebae21"}
Jul 27 17:35:52.061032 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:52.060961    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"
Jul 27 17:35:52.062245 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:52.062215    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:52.062380 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:52.062246    2580 scope.go:117] "RemoveContainer" containerID="f3b53294ff7477f03074df0e1478e795eb01732bc428507a9f1e545c9207c099"
Jul 27 17:35:52.064004 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:52.063984    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69ncf" event={"ID":"455dcde8-ecea-4a34-91d6-212e2cff79d9","Type":"ContainerStarted","Data":"c68f6b8fe3a0d8466f3333489dc281299fece443d3c6ac5e197d14da75e33923"}
Jul 27 17:35:52.064126 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:52.064026    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69ncf" event={"ID":"455dcde8-ecea-4a34-91d6-212e2cff79d9","Type":"ContainerStarted","Data":"5bd5826ceb03ee1f31ec455ca424b6b24c4ba469cbd943495556bdde404b29ae"}
Jul 27 17:35:52.064126 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:52.064058    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69ncf"
Jul 27 17:35:52.065551 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:52.065536    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"
Jul 27 17:35:52.071218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:52.071196    2580 scope.go:117] "RemoveContainer" containerID="803052a86fcdca7c69ce56ddce6687ed87787978cdd3dabb5f96b0940555cfe5"
Jul 27 17:35:52.079799 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:52.079764    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zv6st" podStartSLOduration=2.705181091 podStartE2EDuration="25.07975183s" totalImagesPullingTime="22.374570739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:35:52.079490867 +0000 UTC m=+695.094157308" watchObservedRunningTime="2026-07-27 17:35:52.07975183 +0000 UTC m=+695.094418273"
Jul 27 17:35:52.081664 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:35:52.081640    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ft9c6\" is forbidden: User \"system:node:ip-10-0-131-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-200.ec2.internal' and this object" podUID="cb3d9d78-b539-4b83-aa31-2512cc06f5f7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ft9c6"
Jul 27 17:35:52.103386 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:52.103346    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw" podStartSLOduration=14.103329258 podStartE2EDuration="14.103329258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:35:52.1029981 +0000 UTC m=+695.117664543" watchObservedRunningTime="2026-07-27 17:35:52.103329258 +0000 UTC m=+695.117995702"
Jul 27 17:35:52.105202 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:35:52.105174    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-44grj\" is forbidden: User \"system:node:ip-10-0-131-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-200.ec2.internal' and this object" podUID="0496c7c2-0d73-4597-8535-cf4c6a304cbf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44grj"
Jul 27 17:35:52.124881 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:52.124843    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69ncf" podStartSLOduration=14.124832327 podStartE2EDuration="14.124832327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:35:52.124644456 +0000 UTC m=+695.139310900" watchObservedRunningTime="2026-07-27 17:35:52.124832327 +0000 UTC m=+695.139498771"
Jul 27 17:35:56.382053 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:56.382022    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"]
Jul 27 17:35:56.382576 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:56.382231    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw" podUID="e3f01e94-2a34-4dbb-9568-775452e4918d" containerName="manager" containerID="cri-o://330810959b92e3c207748d3602385c4715be3b4d0fce1af31afbad8db8ccb81f" gracePeriod=10
Jul 27 17:35:56.383923 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:56.383901    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"
Jul 27 17:35:57.092717 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:57.092681    2580 generic.go:356] "Generic (PLEG): container finished" podID="e3f01e94-2a34-4dbb-9568-775452e4918d" containerID="330810959b92e3c207748d3602385c4715be3b4d0fce1af31afbad8db8ccb81f" exitCode=0
Jul 27 17:35:57.092872 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:57.092762    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw" event={"ID":"e3f01e94-2a34-4dbb-9568-775452e4918d","Type":"ContainerDied","Data":"330810959b92e3c207748d3602385c4715be3b4d0fce1af31afbad8db8ccb81f"}
Jul 27 17:35:57.163452 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:57.163422    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"
Jul 27 17:35:57.298089 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:57.298014    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m44tq\" (UniqueName: \"kubernetes.io/projected/e3f01e94-2a34-4dbb-9568-775452e4918d-kube-api-access-m44tq\") pod \"e3f01e94-2a34-4dbb-9568-775452e4918d\" (UID: \"e3f01e94-2a34-4dbb-9568-775452e4918d\") "
Jul 27 17:35:57.298089 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:57.298067    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3f01e94-2a34-4dbb-9568-775452e4918d-extensions-socket-volume\") pod \"e3f01e94-2a34-4dbb-9568-775452e4918d\" (UID: \"e3f01e94-2a34-4dbb-9568-775452e4918d\") "
Jul 27 17:35:57.298452 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:57.298428    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3f01e94-2a34-4dbb-9568-775452e4918d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e3f01e94-2a34-4dbb-9568-775452e4918d" (UID: "e3f01e94-2a34-4dbb-9568-775452e4918d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:35:57.300328 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:57.300303    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3f01e94-2a34-4dbb-9568-775452e4918d-kube-api-access-m44tq" (OuterVolumeSpecName: "kube-api-access-m44tq") pod "e3f01e94-2a34-4dbb-9568-775452e4918d" (UID: "e3f01e94-2a34-4dbb-9568-775452e4918d"). InnerVolumeSpecName "kube-api-access-m44tq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:35:57.399043 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:57.399010    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m44tq\" (UniqueName: \"kubernetes.io/projected/e3f01e94-2a34-4dbb-9568-775452e4918d-kube-api-access-m44tq\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:35:57.399043 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:57.399035    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3f01e94-2a34-4dbb-9568-775452e4918d-extensions-socket-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:35:58.098732 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:58.098704    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"
Jul 27 17:35:58.098931 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:58.098707    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw" event={"ID":"e3f01e94-2a34-4dbb-9568-775452e4918d","Type":"ContainerDied","Data":"321c99cd22a9be6f5f6408b57cb09246c3e717fc2fa070733cc7e4b184ebae21"}
Jul 27 17:35:58.098931 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:58.098849    2580 scope.go:117] "RemoveContainer" containerID="330810959b92e3c207748d3602385c4715be3b4d0fce1af31afbad8db8ccb81f"
Jul 27 17:35:58.126723 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:58.126698    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"]
Jul 27 17:35:58.135317 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:58.135291    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5xlxw"]
Jul 27 17:35:59.476152 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:35:59.476110    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3f01e94-2a34-4dbb-9568-775452e4918d" path="/var/lib/kubelet/pods/e3f01e94-2a34-4dbb-9568-775452e4918d/volumes"
Jul 27 17:36:03.074570 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:03.074536    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-69ncf"
Jul 27 17:36:12.715844 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.715764    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"]
Jul 27 17:36:12.716286 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.716089    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3f01e94-2a34-4dbb-9568-775452e4918d" containerName="manager"
Jul 27 17:36:12.716286 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.716099    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3f01e94-2a34-4dbb-9568-775452e4918d" containerName="manager"
Jul 27 17:36:12.716286 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.716159    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3f01e94-2a34-4dbb-9568-775452e4918d" containerName="manager"
Jul 27 17:36:12.719178 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.719150    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.721824 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.721803    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-g26nl\""
Jul 27 17:36:12.732443 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.732420    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"]
Jul 27 17:36:12.819046 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.819010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd61f14c-29e5-462e-b781-2068d16ab91b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.819236 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.819060    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd61f14c-29e5-462e-b781-2068d16ab91b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.819236 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.819116    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd61f14c-29e5-462e-b781-2068d16ab91b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.819236 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.819148    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m46kd\" (UniqueName: \"kubernetes.io/projected/dd61f14c-29e5-462e-b781-2068d16ab91b-kube-api-access-m46kd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.819236 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.819181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd61f14c-29e5-462e-b781-2068d16ab91b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.819236 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.819232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd61f14c-29e5-462e-b781-2068d16ab91b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.819478 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.819258    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd61f14c-29e5-462e-b781-2068d16ab91b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.819478 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.819347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd61f14c-29e5-462e-b781-2068d16ab91b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.819478 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.819411    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd61f14c-29e5-462e-b781-2068d16ab91b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.920801 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.920766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd61f14c-29e5-462e-b781-2068d16ab91b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.920801 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.920803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd61f14c-29e5-462e-b781-2068d16ab91b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.921043 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.920820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd61f14c-29e5-462e-b781-2068d16ab91b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.921043 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.920950    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m46kd\" (UniqueName: \"kubernetes.io/projected/dd61f14c-29e5-462e-b781-2068d16ab91b-kube-api-access-m46kd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.921043 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.921007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd61f14c-29e5-462e-b781-2068d16ab91b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.921207 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.921124    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd61f14c-29e5-462e-b781-2068d16ab91b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.921207 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.921164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd61f14c-29e5-462e-b781-2068d16ab91b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.921313 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.921208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd61f14c-29e5-462e-b781-2068d16ab91b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.921313 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.921214    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd61f14c-29e5-462e-b781-2068d16ab91b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.921313 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.921248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd61f14c-29e5-462e-b781-2068d16ab91b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.921313 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.921282    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd61f14c-29e5-462e-b781-2068d16ab91b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.921517 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.921477    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd61f14c-29e5-462e-b781-2068d16ab91b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.921517 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.921492    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd61f14c-29e5-462e-b781-2068d16ab91b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.922064 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.922039    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd61f14c-29e5-462e-b781-2068d16ab91b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.923386 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.923358    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd61f14c-29e5-462e-b781-2068d16ab91b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.923610 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.923577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd61f14c-29e5-462e-b781-2068d16ab91b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.928927 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.928907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd61f14c-29e5-462e-b781-2068d16ab91b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:12.929287 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:12.929265    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m46kd\" (UniqueName: \"kubernetes.io/projected/dd61f14c-29e5-462e-b781-2068d16ab91b-kube-api-access-m46kd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-m99fz\" (UID: \"dd61f14c-29e5-462e-b781-2068d16ab91b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:13.029028 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:13.028956    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:13.163724 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:13.163697    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"]
Jul 27 17:36:13.166024 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:36:13.165996    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd61f14c_29e5_462e_b781_2068d16ab91b.slice/crio-eee40b1e9a463d94b3656153ae2a35546852a76ca0c325e5e35d505b2d758605 WatchSource:0}: Error finding container eee40b1e9a463d94b3656153ae2a35546852a76ca0c325e5e35d505b2d758605: Status 404 returned error can't find the container with id eee40b1e9a463d94b3656153ae2a35546852a76ca0c325e5e35d505b2d758605
Jul 27 17:36:13.168331 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:13.168295    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:36:13.168436 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:13.168375    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:36:13.168436 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:13.168424    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:36:14.175650 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:14.175615    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz" event={"ID":"dd61f14c-29e5-462e-b781-2068d16ab91b","Type":"ContainerStarted","Data":"c4f0a0b4dfe9bb14d5a3cd224a7a75d2731b9f219fbe943dea2aad97e9ed4b94"}
Jul 27 17:36:14.176047 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:14.175681    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz" event={"ID":"dd61f14c-29e5-462e-b781-2068d16ab91b","Type":"ContainerStarted","Data":"eee40b1e9a463d94b3656153ae2a35546852a76ca0c325e5e35d505b2d758605"}
Jul 27 17:36:14.197015 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:14.196969    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz" podStartSLOduration=2.196954931 podStartE2EDuration="2.196954931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:36:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:36:14.196517428 +0000 UTC m=+717.211183872" watchObservedRunningTime="2026-07-27 17:36:14.196954931 +0000 UTC m=+717.211621375"
Jul 27 17:36:15.030046 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.030008    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:15.034931 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.034907    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:15.181360 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.181324    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:15.182181 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.182158    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:36:15.278713 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.278675    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"]
Jul 27 17:36:15.282084 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.282022    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"
Jul 27 17:36:15.285448 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.285426    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 17:36:15.294211 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.294187    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"]
Jul 27 17:36:15.341444 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.341408    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6lmd\" (UniqueName: \"kubernetes.io/projected/1f7bb5dc-6f63-4245-8149-0d59be31cc87-kube-api-access-k6lmd\") pod \"limitador-limitador-64c94fd64f-8hfjq\" (UID: \"1f7bb5dc-6f63-4245-8149-0d59be31cc87\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"
Jul 27 17:36:15.341746 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.341484    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f7bb5dc-6f63-4245-8149-0d59be31cc87-config-file\") pod \"limitador-limitador-64c94fd64f-8hfjq\" (UID: \"1f7bb5dc-6f63-4245-8149-0d59be31cc87\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"
Jul 27 17:36:15.349404 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.349379    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"]
Jul 27 17:36:15.442254 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.442224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6lmd\" (UniqueName: \"kubernetes.io/projected/1f7bb5dc-6f63-4245-8149-0d59be31cc87-kube-api-access-k6lmd\") pod \"limitador-limitador-64c94fd64f-8hfjq\" (UID: \"1f7bb5dc-6f63-4245-8149-0d59be31cc87\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"
Jul 27 17:36:15.442380 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.442268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f7bb5dc-6f63-4245-8149-0d59be31cc87-config-file\") pod \"limitador-limitador-64c94fd64f-8hfjq\" (UID: \"1f7bb5dc-6f63-4245-8149-0d59be31cc87\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"
Jul 27 17:36:15.442867 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.442850    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f7bb5dc-6f63-4245-8149-0d59be31cc87-config-file\") pod \"limitador-limitador-64c94fd64f-8hfjq\" (UID: \"1f7bb5dc-6f63-4245-8149-0d59be31cc87\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"
Jul 27 17:36:15.451511 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.451481    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6lmd\" (UniqueName: \"kubernetes.io/projected/1f7bb5dc-6f63-4245-8149-0d59be31cc87-kube-api-access-k6lmd\") pod \"limitador-limitador-64c94fd64f-8hfjq\" (UID: \"1f7bb5dc-6f63-4245-8149-0d59be31cc87\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"
Jul 27 17:36:15.594339 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.594251    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"
Jul 27 17:36:15.724338 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:15.724310    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"]
Jul 27 17:36:15.727612 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:36:15.727532    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7bb5dc_6f63_4245_8149_0d59be31cc87.slice/crio-5f9f77397ab1f6e9fb6d75ba73b95e92b979262214e768edb8db70e8387513cd WatchSource:0}: Error finding container 5f9f77397ab1f6e9fb6d75ba73b95e92b979262214e768edb8db70e8387513cd: Status 404 returned error can't find the container with id 5f9f77397ab1f6e9fb6d75ba73b95e92b979262214e768edb8db70e8387513cd
Jul 27 17:36:16.063516 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.063479    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-f5lqq"]
Jul 27 17:36:16.067955 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.067936    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f5lqq"
Jul 27 17:36:16.070496 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.070478    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bfgpj\""
Jul 27 17:36:16.074208 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.074179    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-f5lqq"]
Jul 27 17:36:16.148778 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.148744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnzxr\" (UniqueName: \"kubernetes.io/projected/21f92977-1421-4e22-8c7d-309e1b553de9-kube-api-access-qnzxr\") pod \"authorino-58cd955675-f5lqq\" (UID: \"21f92977-1421-4e22-8c7d-309e1b553de9\") " pod="kuadrant-system/authorino-58cd955675-f5lqq"
Jul 27 17:36:16.187089 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.187058    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq" event={"ID":"1f7bb5dc-6f63-4245-8149-0d59be31cc87","Type":"ContainerStarted","Data":"5f9f77397ab1f6e9fb6d75ba73b95e92b979262214e768edb8db70e8387513cd"}
Jul 27 17:36:16.206957 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.206930    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-kj29p"]
Jul 27 17:36:16.210279 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.210264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kj29p"
Jul 27 17:36:16.216837 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.216814    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kj29p"]
Jul 27 17:36:16.249849 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.249821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnzxr\" (UniqueName: \"kubernetes.io/projected/21f92977-1421-4e22-8c7d-309e1b553de9-kube-api-access-qnzxr\") pod \"authorino-58cd955675-f5lqq\" (UID: \"21f92977-1421-4e22-8c7d-309e1b553de9\") " pod="kuadrant-system/authorino-58cd955675-f5lqq"
Jul 27 17:36:16.249963 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.249862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzb2q\" (UniqueName: \"kubernetes.io/projected/f3ca02d0-2c6e-42ed-a453-57422efa5b9d-kube-api-access-qzb2q\") pod \"authorino-75d556bd77-kj29p\" (UID: \"f3ca02d0-2c6e-42ed-a453-57422efa5b9d\") " pod="kuadrant-system/authorino-75d556bd77-kj29p"
Jul 27 17:36:16.258526 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.258502    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnzxr\" (UniqueName: \"kubernetes.io/projected/21f92977-1421-4e22-8c7d-309e1b553de9-kube-api-access-qnzxr\") pod \"authorino-58cd955675-f5lqq\" (UID: \"21f92977-1421-4e22-8c7d-309e1b553de9\") " pod="kuadrant-system/authorino-58cd955675-f5lqq"
Jul 27 17:36:16.350807 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.350738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzb2q\" (UniqueName: \"kubernetes.io/projected/f3ca02d0-2c6e-42ed-a453-57422efa5b9d-kube-api-access-qzb2q\") pod \"authorino-75d556bd77-kj29p\" (UID: \"f3ca02d0-2c6e-42ed-a453-57422efa5b9d\") " pod="kuadrant-system/authorino-75d556bd77-kj29p"
Jul 27 17:36:16.359512 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.359484    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzb2q\" (UniqueName: \"kubernetes.io/projected/f3ca02d0-2c6e-42ed-a453-57422efa5b9d-kube-api-access-qzb2q\") pod \"authorino-75d556bd77-kj29p\" (UID: \"f3ca02d0-2c6e-42ed-a453-57422efa5b9d\") " pod="kuadrant-system/authorino-75d556bd77-kj29p"
Jul 27 17:36:16.378428 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.378406    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f5lqq"
Jul 27 17:36:16.501936 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.501900    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-f5lqq"]
Jul 27 17:36:16.505632 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:36:16.505601    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21f92977_1421_4e22_8c7d_309e1b553de9.slice/crio-c91acfde58c5b4fe4259eef93cfb49128aee345abcec1bfaee5313284e94b30c WatchSource:0}: Error finding container c91acfde58c5b4fe4259eef93cfb49128aee345abcec1bfaee5313284e94b30c: Status 404 returned error can't find the container with id c91acfde58c5b4fe4259eef93cfb49128aee345abcec1bfaee5313284e94b30c
Jul 27 17:36:16.520228 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.520206    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kj29p"
Jul 27 17:36:16.646939 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:16.646667    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kj29p"]
Jul 27 17:36:16.649807 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:36:16.649772    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3ca02d0_2c6e_42ed_a453_57422efa5b9d.slice/crio-338f25df1562eccdc61e4e49537c7c989c365d082d8f93f16adc344b9e9f1e52 WatchSource:0}: Error finding container 338f25df1562eccdc61e4e49537c7c989c365d082d8f93f16adc344b9e9f1e52: Status 404 returned error can't find the container with id 338f25df1562eccdc61e4e49537c7c989c365d082d8f93f16adc344b9e9f1e52
Jul 27 17:36:17.193980 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:17.193946    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f5lqq" event={"ID":"21f92977-1421-4e22-8c7d-309e1b553de9","Type":"ContainerStarted","Data":"c91acfde58c5b4fe4259eef93cfb49128aee345abcec1bfaee5313284e94b30c"}
Jul 27 17:36:17.195647 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:17.195569    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kj29p" event={"ID":"f3ca02d0-2c6e-42ed-a453-57422efa5b9d","Type":"ContainerStarted","Data":"338f25df1562eccdc61e4e49537c7c989c365d082d8f93f16adc344b9e9f1e52"}
Jul 27 17:36:22.233467 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:22.233417    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f5lqq" event={"ID":"21f92977-1421-4e22-8c7d-309e1b553de9","Type":"ContainerStarted","Data":"c07e146a826c214dfbcb528dcb056bbd6a0fc655397ff9aa39c9eb03ece4d8b5"}
Jul 27 17:36:22.235042 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:22.235014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq" event={"ID":"1f7bb5dc-6f63-4245-8149-0d59be31cc87","Type":"ContainerStarted","Data":"48a290ce38ecd4b100df769d43e9267b13190259eff676e9c0d56de3ac249df4"}
Jul 27 17:36:22.235172 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:22.235076    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"
Jul 27 17:36:22.236451 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:22.236424    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kj29p" event={"ID":"f3ca02d0-2c6e-42ed-a453-57422efa5b9d","Type":"ContainerStarted","Data":"5a3fe57757acd52762df8b2cc005891f2f2521984ad2ba654105836e867bd592"}
Jul 27 17:36:22.249656 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:22.249619    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-f5lqq" podStartSLOduration=1.109904132 podStartE2EDuration="6.249605823s" totalImagesPullingTime="5.139701691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:36:22.249317412 +0000 UTC m=+725.263983856" watchObservedRunningTime="2026-07-27 17:36:22.249605823 +0000 UTC m=+725.264272263"
Jul 27 17:36:22.265515 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:22.265466    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-kj29p" podStartSLOduration=1.28567059 podStartE2EDuration="6.265452119s" totalImagesPullingTime="4.979781529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:36:22.264653026 +0000 UTC m=+725.279319472" watchObservedRunningTime="2026-07-27 17:36:22.265452119 +0000 UTC m=+725.280118562"
Jul 27 17:36:22.284032 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:22.283983    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq" podStartSLOduration=1.238213737 podStartE2EDuration="7.283969301s" totalImagesPullingTime="6.045755564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:36:22.28352231 +0000 UTC m=+725.298188757" watchObservedRunningTime="2026-07-27 17:36:22.283969301 +0000 UTC m=+725.298635792"
Jul 27 17:36:22.290977 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:22.290953    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-f5lqq"]
Jul 27 17:36:24.245563 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:24.245520    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-f5lqq" podUID="21f92977-1421-4e22-8c7d-309e1b553de9" containerName="authorino" containerID="cri-o://c07e146a826c214dfbcb528dcb056bbd6a0fc655397ff9aa39c9eb03ece4d8b5" gracePeriod=30
Jul 27 17:36:24.494510 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:24.494487    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f5lqq"
Jul 27 17:36:24.630313 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:24.630231    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnzxr\" (UniqueName: \"kubernetes.io/projected/21f92977-1421-4e22-8c7d-309e1b553de9-kube-api-access-qnzxr\") pod \"21f92977-1421-4e22-8c7d-309e1b553de9\" (UID: \"21f92977-1421-4e22-8c7d-309e1b553de9\") "
Jul 27 17:36:24.632301 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:24.632273    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21f92977-1421-4e22-8c7d-309e1b553de9-kube-api-access-qnzxr" (OuterVolumeSpecName: "kube-api-access-qnzxr") pod "21f92977-1421-4e22-8c7d-309e1b553de9" (UID: "21f92977-1421-4e22-8c7d-309e1b553de9"). InnerVolumeSpecName "kube-api-access-qnzxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:36:24.731704 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:24.731669    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnzxr\" (UniqueName: \"kubernetes.io/projected/21f92977-1421-4e22-8c7d-309e1b553de9-kube-api-access-qnzxr\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:36:25.253788 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:25.253753    2580 generic.go:356] "Generic (PLEG): container finished" podID="21f92977-1421-4e22-8c7d-309e1b553de9" containerID="c07e146a826c214dfbcb528dcb056bbd6a0fc655397ff9aa39c9eb03ece4d8b5" exitCode=0
Jul 27 17:36:25.254282 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:25.253794    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-f5lqq"
Jul 27 17:36:25.254282 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:25.253840    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f5lqq" event={"ID":"21f92977-1421-4e22-8c7d-309e1b553de9","Type":"ContainerDied","Data":"c07e146a826c214dfbcb528dcb056bbd6a0fc655397ff9aa39c9eb03ece4d8b5"}
Jul 27 17:36:25.254282 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:25.253887    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-f5lqq" event={"ID":"21f92977-1421-4e22-8c7d-309e1b553de9","Type":"ContainerDied","Data":"c91acfde58c5b4fe4259eef93cfb49128aee345abcec1bfaee5313284e94b30c"}
Jul 27 17:36:25.254282 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:25.253912    2580 scope.go:117] "RemoveContainer" containerID="c07e146a826c214dfbcb528dcb056bbd6a0fc655397ff9aa39c9eb03ece4d8b5"
Jul 27 17:36:25.262466 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:25.262450    2580 scope.go:117] "RemoveContainer" containerID="c07e146a826c214dfbcb528dcb056bbd6a0fc655397ff9aa39c9eb03ece4d8b5"
Jul 27 17:36:25.262736 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:36:25.262717    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c07e146a826c214dfbcb528dcb056bbd6a0fc655397ff9aa39c9eb03ece4d8b5\": container with ID starting with c07e146a826c214dfbcb528dcb056bbd6a0fc655397ff9aa39c9eb03ece4d8b5 not found: ID does not exist" containerID="c07e146a826c214dfbcb528dcb056bbd6a0fc655397ff9aa39c9eb03ece4d8b5"
Jul 27 17:36:25.262806 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:25.262744    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c07e146a826c214dfbcb528dcb056bbd6a0fc655397ff9aa39c9eb03ece4d8b5"} err="failed to get container status \"c07e146a826c214dfbcb528dcb056bbd6a0fc655397ff9aa39c9eb03ece4d8b5\": rpc error: code = NotFound desc = could not find container \"c07e146a826c214dfbcb528dcb056bbd6a0fc655397ff9aa39c9eb03ece4d8b5\": container with ID starting with c07e146a826c214dfbcb528dcb056bbd6a0fc655397ff9aa39c9eb03ece4d8b5 not found: ID does not exist"
Jul 27 17:36:25.273696 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:25.273673    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-f5lqq"]
Jul 27 17:36:25.282675 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:25.282490    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-f5lqq"]
Jul 27 17:36:25.476201 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:25.476167    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21f92977-1421-4e22-8c7d-309e1b553de9" path="/var/lib/kubelet/pods/21f92977-1421-4e22-8c7d-309e1b553de9/volumes"
Jul 27 17:36:30.797347 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:30.797310    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"]
Jul 27 17:36:30.797887 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:30.797497    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq" podUID="1f7bb5dc-6f63-4245-8149-0d59be31cc87" containerName="limitador" containerID="cri-o://48a290ce38ecd4b100df769d43e9267b13190259eff676e9c0d56de3ac249df4" gracePeriod=30
Jul 27 17:36:30.799986 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:30.799955    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"
Jul 27 17:36:31.289481 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:31.289446    2580 generic.go:356] "Generic (PLEG): container finished" podID="1f7bb5dc-6f63-4245-8149-0d59be31cc87" containerID="48a290ce38ecd4b100df769d43e9267b13190259eff676e9c0d56de3ac249df4" exitCode=0
Jul 27 17:36:31.289637 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:31.289501    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq" event={"ID":"1f7bb5dc-6f63-4245-8149-0d59be31cc87","Type":"ContainerDied","Data":"48a290ce38ecd4b100df769d43e9267b13190259eff676e9c0d56de3ac249df4"}
Jul 27 17:36:31.347949 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:31.347924    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"
Jul 27 17:36:31.489969 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:31.489942    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6lmd\" (UniqueName: \"kubernetes.io/projected/1f7bb5dc-6f63-4245-8149-0d59be31cc87-kube-api-access-k6lmd\") pod \"1f7bb5dc-6f63-4245-8149-0d59be31cc87\" (UID: \"1f7bb5dc-6f63-4245-8149-0d59be31cc87\") "
Jul 27 17:36:31.490128 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:31.490004    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f7bb5dc-6f63-4245-8149-0d59be31cc87-config-file\") pod \"1f7bb5dc-6f63-4245-8149-0d59be31cc87\" (UID: \"1f7bb5dc-6f63-4245-8149-0d59be31cc87\") "
Jul 27 17:36:31.490388 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:31.490361    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f7bb5dc-6f63-4245-8149-0d59be31cc87-config-file" (OuterVolumeSpecName: "config-file") pod "1f7bb5dc-6f63-4245-8149-0d59be31cc87" (UID: "1f7bb5dc-6f63-4245-8149-0d59be31cc87"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:36:31.492054 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:31.492033    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f7bb5dc-6f63-4245-8149-0d59be31cc87-kube-api-access-k6lmd" (OuterVolumeSpecName: "kube-api-access-k6lmd") pod "1f7bb5dc-6f63-4245-8149-0d59be31cc87" (UID: "1f7bb5dc-6f63-4245-8149-0d59be31cc87"). InnerVolumeSpecName "kube-api-access-k6lmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:36:31.591340 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:31.591308    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6lmd\" (UniqueName: \"kubernetes.io/projected/1f7bb5dc-6f63-4245-8149-0d59be31cc87-kube-api-access-k6lmd\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:36:31.591340 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:31.591337    2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f7bb5dc-6f63-4245-8149-0d59be31cc87-config-file\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:36:32.295653 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:32.295616    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"
Jul 27 17:36:32.295653 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:32.295633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8hfjq" event={"ID":"1f7bb5dc-6f63-4245-8149-0d59be31cc87","Type":"ContainerDied","Data":"5f9f77397ab1f6e9fb6d75ba73b95e92b979262214e768edb8db70e8387513cd"}
Jul 27 17:36:32.296145 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:32.295700    2580 scope.go:117] "RemoveContainer" containerID="48a290ce38ecd4b100df769d43e9267b13190259eff676e9c0d56de3ac249df4"
Jul 27 17:36:32.317559 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:32.317533    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"]
Jul 27 17:36:32.324522 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:32.324495    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8hfjq"]
Jul 27 17:36:33.476930 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:33.476896    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f7bb5dc-6f63-4245-8149-0d59be31cc87" path="/var/lib/kubelet/pods/1f7bb5dc-6f63-4245-8149-0d59be31cc87/volumes"
Jul 27 17:36:36.797207 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:36.797176    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jcpcb"]
Jul 27 17:36:36.797574 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:36.797493    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f92977-1421-4e22-8c7d-309e1b553de9" containerName="authorino"
Jul 27 17:36:36.797574 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:36.797504    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f92977-1421-4e22-8c7d-309e1b553de9" containerName="authorino"
Jul 27 17:36:36.797574 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:36.797513    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f7bb5dc-6f63-4245-8149-0d59be31cc87" containerName="limitador"
Jul 27 17:36:36.797574 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:36.797518    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f7bb5dc-6f63-4245-8149-0d59be31cc87" containerName="limitador"
Jul 27 17:36:36.797574 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:36.797572    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f7bb5dc-6f63-4245-8149-0d59be31cc87" containerName="limitador"
Jul 27 17:36:36.797749 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:36.797596    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f92977-1421-4e22-8c7d-309e1b553de9" containerName="authorino"
Jul 27 17:36:36.801769 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:36.801748    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcpcb"
Jul 27 17:36:36.804576 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:36.804555    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 27 17:36:36.804723 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:36.804642    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qppjx\""
Jul 27 17:36:36.805738 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:36.805720    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 17:36:36.805854 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:36.805740    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 17:36:36.811486 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:36.811463    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jcpcb"]
Jul 27 17:36:36.936930 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:36.936894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/da4d4ea8-fd78-4e24-ab5b-ad07aa57c8e4-data\") pod \"postgres-69fb4594cf-jcpcb\" (UID: \"da4d4ea8-fd78-4e24-ab5b-ad07aa57c8e4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcpcb"
Jul 27 17:36:36.937095 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:36.937010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6fdm\" (UniqueName: \"kubernetes.io/projected/da4d4ea8-fd78-4e24-ab5b-ad07aa57c8e4-kube-api-access-l6fdm\") pod \"postgres-69fb4594cf-jcpcb\" (UID: \"da4d4ea8-fd78-4e24-ab5b-ad07aa57c8e4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcpcb"
Jul 27 17:36:37.037772 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:37.037738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6fdm\" (UniqueName: \"kubernetes.io/projected/da4d4ea8-fd78-4e24-ab5b-ad07aa57c8e4-kube-api-access-l6fdm\") pod \"postgres-69fb4594cf-jcpcb\" (UID: \"da4d4ea8-fd78-4e24-ab5b-ad07aa57c8e4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcpcb"
Jul 27 17:36:37.037912 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:37.037779    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/da4d4ea8-fd78-4e24-ab5b-ad07aa57c8e4-data\") pod \"postgres-69fb4594cf-jcpcb\" (UID: \"da4d4ea8-fd78-4e24-ab5b-ad07aa57c8e4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcpcb"
Jul 27 17:36:37.038144 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:37.038126    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/da4d4ea8-fd78-4e24-ab5b-ad07aa57c8e4-data\") pod \"postgres-69fb4594cf-jcpcb\" (UID: \"da4d4ea8-fd78-4e24-ab5b-ad07aa57c8e4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcpcb"
Jul 27 17:36:37.046757 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:37.046725    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6fdm\" (UniqueName: \"kubernetes.io/projected/da4d4ea8-fd78-4e24-ab5b-ad07aa57c8e4-kube-api-access-l6fdm\") pod \"postgres-69fb4594cf-jcpcb\" (UID: \"da4d4ea8-fd78-4e24-ab5b-ad07aa57c8e4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcpcb"
Jul 27 17:36:37.113771 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:37.113696    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcpcb"
Jul 27 17:36:37.244667 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:37.244641    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jcpcb"]
Jul 27 17:36:37.247213 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:36:37.247183    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4d4ea8_fd78_4e24_ab5b_ad07aa57c8e4.slice/crio-72e249d4f3483ac00b2c74ecd7c3dd40bd86387851655067cb78ef68cda48469 WatchSource:0}: Error finding container 72e249d4f3483ac00b2c74ecd7c3dd40bd86387851655067cb78ef68cda48469: Status 404 returned error can't find the container with id 72e249d4f3483ac00b2c74ecd7c3dd40bd86387851655067cb78ef68cda48469
Jul 27 17:36:37.325778 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:37.325742    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcpcb" event={"ID":"da4d4ea8-fd78-4e24-ab5b-ad07aa57c8e4","Type":"ContainerStarted","Data":"72e249d4f3483ac00b2c74ecd7c3dd40bd86387851655067cb78ef68cda48469"}
Jul 27 17:36:42.353885 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:42.353791    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcpcb" event={"ID":"da4d4ea8-fd78-4e24-ab5b-ad07aa57c8e4","Type":"ContainerStarted","Data":"adc9bb4062ce758a12a6271cab22981ff0f891b9fc288dabc8d6d3ded26a4af5"}
Jul 27 17:36:42.354428 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:42.353924    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcpcb"
Jul 27 17:36:42.369775 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:42.369728    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcpcb" podStartSLOduration=1.531121714 podStartE2EDuration="6.369713916s" totalImagesPullingTime="4.838592202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:36:42.368741646 +0000 UTC m=+745.383408091" watchObservedRunningTime="2026-07-27 17:36:42.369713916 +0000 UTC m=+745.384380359"
Jul 27 17:36:48.386349 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:48.386320    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jcpcb"
Jul 27 17:36:48.907990 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:48.907957    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2gg2z"]
Jul 27 17:36:48.914943 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:48.914910    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2gg2z"
Jul 27 17:36:48.915947 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:48.915921    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2gg2z"]
Jul 27 17:36:49.044732 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.044690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2vdm\" (UniqueName: \"kubernetes.io/projected/6feff316-2405-45aa-8dc4-c24332c9b66f-kube-api-access-r2vdm\") pod \"authorino-5d4b67c446-2gg2z\" (UID: \"6feff316-2405-45aa-8dc4-c24332c9b66f\") " pod="kuadrant-system/authorino-5d4b67c446-2gg2z"
Jul 27 17:36:49.145150 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.145117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2vdm\" (UniqueName: \"kubernetes.io/projected/6feff316-2405-45aa-8dc4-c24332c9b66f-kube-api-access-r2vdm\") pod \"authorino-5d4b67c446-2gg2z\" (UID: \"6feff316-2405-45aa-8dc4-c24332c9b66f\") " pod="kuadrant-system/authorino-5d4b67c446-2gg2z"
Jul 27 17:36:49.146727 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.146697    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2gg2z"]
Jul 27 17:36:49.146925 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:36:49.146905    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-r2vdm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-2gg2z" podUID="6feff316-2405-45aa-8dc4-c24332c9b66f"
Jul 27 17:36:49.155937 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.155916    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2vdm\" (UniqueName: \"kubernetes.io/projected/6feff316-2405-45aa-8dc4-c24332c9b66f-kube-api-access-r2vdm\") pod \"authorino-5d4b67c446-2gg2z\" (UID: \"6feff316-2405-45aa-8dc4-c24332c9b66f\") " pod="kuadrant-system/authorino-5d4b67c446-2gg2z"
Jul 27 17:36:49.382460 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.382372    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b7cfb4cc-nhj8h"]
Jul 27 17:36:49.383087 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.383065    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2gg2z"
Jul 27 17:36:49.386563 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.386539    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b7cfb4cc-nhj8h"
Jul 27 17:36:49.388942 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.388921    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 27 17:36:49.390713 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.390691    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2gg2z"
Jul 27 17:36:49.392079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.392056    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b7cfb4cc-nhj8h"]
Jul 27 17:36:49.448064 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.448035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/86a4683d-c29c-49a1-ab98-98b29e3ff09a-tls-cert\") pod \"authorino-5b7cfb4cc-nhj8h\" (UID: \"86a4683d-c29c-49a1-ab98-98b29e3ff09a\") " pod="kuadrant-system/authorino-5b7cfb4cc-nhj8h"
Jul 27 17:36:49.448202 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.448090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6dct\" (UniqueName: \"kubernetes.io/projected/86a4683d-c29c-49a1-ab98-98b29e3ff09a-kube-api-access-z6dct\") pod \"authorino-5b7cfb4cc-nhj8h\" (UID: \"86a4683d-c29c-49a1-ab98-98b29e3ff09a\") " pod="kuadrant-system/authorino-5b7cfb4cc-nhj8h"
Jul 27 17:36:49.548447 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.548416    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2vdm\" (UniqueName: \"kubernetes.io/projected/6feff316-2405-45aa-8dc4-c24332c9b66f-kube-api-access-r2vdm\") pod \"6feff316-2405-45aa-8dc4-c24332c9b66f\" (UID: \"6feff316-2405-45aa-8dc4-c24332c9b66f\") "
Jul 27 17:36:49.548657 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.548597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6dct\" (UniqueName: \"kubernetes.io/projected/86a4683d-c29c-49a1-ab98-98b29e3ff09a-kube-api-access-z6dct\") pod \"authorino-5b7cfb4cc-nhj8h\" (UID: \"86a4683d-c29c-49a1-ab98-98b29e3ff09a\") " pod="kuadrant-system/authorino-5b7cfb4cc-nhj8h"
Jul 27 17:36:49.548730 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.548669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/86a4683d-c29c-49a1-ab98-98b29e3ff09a-tls-cert\") pod \"authorino-5b7cfb4cc-nhj8h\" (UID: \"86a4683d-c29c-49a1-ab98-98b29e3ff09a\") " pod="kuadrant-system/authorino-5b7cfb4cc-nhj8h"
Jul 27 17:36:49.550730 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.550703    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6feff316-2405-45aa-8dc4-c24332c9b66f-kube-api-access-r2vdm" (OuterVolumeSpecName: "kube-api-access-r2vdm") pod "6feff316-2405-45aa-8dc4-c24332c9b66f" (UID: "6feff316-2405-45aa-8dc4-c24332c9b66f"). InnerVolumeSpecName "kube-api-access-r2vdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:36:49.551073 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.551053    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/86a4683d-c29c-49a1-ab98-98b29e3ff09a-tls-cert\") pod \"authorino-5b7cfb4cc-nhj8h\" (UID: \"86a4683d-c29c-49a1-ab98-98b29e3ff09a\") " pod="kuadrant-system/authorino-5b7cfb4cc-nhj8h"
Jul 27 17:36:49.556784 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.556615    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6dct\" (UniqueName: \"kubernetes.io/projected/86a4683d-c29c-49a1-ab98-98b29e3ff09a-kube-api-access-z6dct\") pod \"authorino-5b7cfb4cc-nhj8h\" (UID: \"86a4683d-c29c-49a1-ab98-98b29e3ff09a\") " pod="kuadrant-system/authorino-5b7cfb4cc-nhj8h"
Jul 27 17:36:49.649278 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.649194    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2vdm\" (UniqueName: \"kubernetes.io/projected/6feff316-2405-45aa-8dc4-c24332c9b66f-kube-api-access-r2vdm\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:36:49.696599 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.696552    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b7cfb4cc-nhj8h"
Jul 27 17:36:49.829861 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:49.829782    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b7cfb4cc-nhj8h"]
Jul 27 17:36:49.832532 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:36:49.832498    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86a4683d_c29c_49a1_ab98_98b29e3ff09a.slice/crio-e03a96740584499ed584d1b535937c5b106c83c66f33b7875aa23f0adb9a2be8 WatchSource:0}: Error finding container e03a96740584499ed584d1b535937c5b106c83c66f33b7875aa23f0adb9a2be8: Status 404 returned error can't find the container with id e03a96740584499ed584d1b535937c5b106c83c66f33b7875aa23f0adb9a2be8
Jul 27 17:36:50.389827 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:50.389793    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b7cfb4cc-nhj8h" event={"ID":"86a4683d-c29c-49a1-ab98-98b29e3ff09a","Type":"ContainerStarted","Data":"781da857054bd7889b730e828b603ebbbf76608cc6ac647e45f4c3d3e3119823"}
Jul 27 17:36:50.389827 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:50.389836    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b7cfb4cc-nhj8h" event={"ID":"86a4683d-c29c-49a1-ab98-98b29e3ff09a","Type":"ContainerStarted","Data":"e03a96740584499ed584d1b535937c5b106c83c66f33b7875aa23f0adb9a2be8"}
Jul 27 17:36:50.390349 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:50.389856    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2gg2z"
Jul 27 17:36:50.406551 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:50.406507    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b7cfb4cc-nhj8h" podStartSLOduration=0.996278001 podStartE2EDuration="1.406492794s" totalImagesPullingTime="410.214793ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:36:50.405041004 +0000 UTC m=+753.419707449" watchObservedRunningTime="2026-07-27 17:36:50.406492794 +0000 UTC m=+753.421159238"
Jul 27 17:36:50.445347 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:50.445276    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2gg2z"]
Jul 27 17:36:50.451004 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:50.450972    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kj29p"]
Jul 27 17:36:50.451435 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:50.451379    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-kj29p" podUID="f3ca02d0-2c6e-42ed-a453-57422efa5b9d" containerName="authorino" containerID="cri-o://5a3fe57757acd52762df8b2cc005891f2f2521984ad2ba654105836e867bd592" gracePeriod=30
Jul 27 17:36:50.454697 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:50.454660    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2gg2z"]
Jul 27 17:36:50.689508 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:50.689484    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kj29p"
Jul 27 17:36:50.757593 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:50.757562    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzb2q\" (UniqueName: \"kubernetes.io/projected/f3ca02d0-2c6e-42ed-a453-57422efa5b9d-kube-api-access-qzb2q\") pod \"f3ca02d0-2c6e-42ed-a453-57422efa5b9d\" (UID: \"f3ca02d0-2c6e-42ed-a453-57422efa5b9d\") "
Jul 27 17:36:50.759518 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:50.759490    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3ca02d0-2c6e-42ed-a453-57422efa5b9d-kube-api-access-qzb2q" (OuterVolumeSpecName: "kube-api-access-qzb2q") pod "f3ca02d0-2c6e-42ed-a453-57422efa5b9d" (UID: "f3ca02d0-2c6e-42ed-a453-57422efa5b9d"). InnerVolumeSpecName "kube-api-access-qzb2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:36:50.858115 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:50.858044    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzb2q\" (UniqueName: \"kubernetes.io/projected/f3ca02d0-2c6e-42ed-a453-57422efa5b9d-kube-api-access-qzb2q\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:36:51.396071 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:51.396038    2580 generic.go:356] "Generic (PLEG): container finished" podID="f3ca02d0-2c6e-42ed-a453-57422efa5b9d" containerID="5a3fe57757acd52762df8b2cc005891f2f2521984ad2ba654105836e867bd592" exitCode=0
Jul 27 17:36:51.396561 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:51.396083    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kj29p"
Jul 27 17:36:51.396561 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:51.396116    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kj29p" event={"ID":"f3ca02d0-2c6e-42ed-a453-57422efa5b9d","Type":"ContainerDied","Data":"5a3fe57757acd52762df8b2cc005891f2f2521984ad2ba654105836e867bd592"}
Jul 27 17:36:51.396561 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:51.396161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kj29p" event={"ID":"f3ca02d0-2c6e-42ed-a453-57422efa5b9d","Type":"ContainerDied","Data":"338f25df1562eccdc61e4e49537c7c989c365d082d8f93f16adc344b9e9f1e52"}
Jul 27 17:36:51.396561 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:51.396178    2580 scope.go:117] "RemoveContainer" containerID="5a3fe57757acd52762df8b2cc005891f2f2521984ad2ba654105836e867bd592"
Jul 27 17:36:51.405221 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:51.405204    2580 scope.go:117] "RemoveContainer" containerID="5a3fe57757acd52762df8b2cc005891f2f2521984ad2ba654105836e867bd592"
Jul 27 17:36:51.405478 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:36:51.405455    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a3fe57757acd52762df8b2cc005891f2f2521984ad2ba654105836e867bd592\": container with ID starting with 5a3fe57757acd52762df8b2cc005891f2f2521984ad2ba654105836e867bd592 not found: ID does not exist" containerID="5a3fe57757acd52762df8b2cc005891f2f2521984ad2ba654105836e867bd592"
Jul 27 17:36:51.405529 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:51.405487    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a3fe57757acd52762df8b2cc005891f2f2521984ad2ba654105836e867bd592"} err="failed to get container status \"5a3fe57757acd52762df8b2cc005891f2f2521984ad2ba654105836e867bd592\": rpc error: code = NotFound desc = could not find container \"5a3fe57757acd52762df8b2cc005891f2f2521984ad2ba654105836e867bd592\": container with ID starting with 5a3fe57757acd52762df8b2cc005891f2f2521984ad2ba654105836e867bd592 not found: ID does not exist"
Jul 27 17:36:51.418132 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:51.418080    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kj29p"]
Jul 27 17:36:51.421765 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:51.421741    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kj29p"]
Jul 27 17:36:51.475700 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:51.475676    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6feff316-2405-45aa-8dc4-c24332c9b66f" path="/var/lib/kubelet/pods/6feff316-2405-45aa-8dc4-c24332c9b66f/volumes"
Jul 27 17:36:51.475905 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:51.475893    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3ca02d0-2c6e-42ed-a453-57422efa5b9d" path="/var/lib/kubelet/pods/f3ca02d0-2c6e-42ed-a453-57422efa5b9d/volumes"
Jul 27 17:36:55.008325 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.008295    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76cc5b548d-ghw4t"]
Jul 27 17:36:55.008806 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.008700    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ca02d0-2c6e-42ed-a453-57422efa5b9d" containerName="authorino"
Jul 27 17:36:55.008806 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.008717    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ca02d0-2c6e-42ed-a453-57422efa5b9d" containerName="authorino"
Jul 27 17:36:55.008925 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.008819    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3ca02d0-2c6e-42ed-a453-57422efa5b9d" containerName="authorino"
Jul 27 17:36:55.091302 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.091265    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76cc5b548d-ghw4t"]
Jul 27 17:36:55.091484 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.091364    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76cc5b548d-ghw4t"
Jul 27 17:36:55.094340 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.094322    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 17:36:55.094536 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.094516    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 17:36:55.094604 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.094573    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z8v8w\""
Jul 27 17:36:55.180226 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.180188    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d55c76586-wgbrs"]
Jul 27 17:36:55.191684 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.191652    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76784a43-98c6-4e5d-bca7-c43bc6086a8b-webhook-cert\") pod \"maas-controller-76cc5b548d-ghw4t\" (UID: \"76784a43-98c6-4e5d-bca7-c43bc6086a8b\") " pod="opendatahub/maas-controller-76cc5b548d-ghw4t"
Jul 27 17:36:55.191846 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.191715    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4z4q\" (UniqueName: \"kubernetes.io/projected/76784a43-98c6-4e5d-bca7-c43bc6086a8b-kube-api-access-b4z4q\") pod \"maas-controller-76cc5b548d-ghw4t\" (UID: \"76784a43-98c6-4e5d-bca7-c43bc6086a8b\") " pod="opendatahub/maas-controller-76cc5b548d-ghw4t"
Jul 27 17:36:55.199385 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.199358    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d55c76586-wgbrs"]
Jul 27 17:36:55.199514 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.199445    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d55c76586-wgbrs"
Jul 27 17:36:55.292936 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.292862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/743a17aa-ce64-4fd5-8032-451784fecb0b-webhook-cert\") pod \"maas-controller-d55c76586-wgbrs\" (UID: \"743a17aa-ce64-4fd5-8032-451784fecb0b\") " pod="opendatahub/maas-controller-d55c76586-wgbrs"
Jul 27 17:36:55.292936 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.292928    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76784a43-98c6-4e5d-bca7-c43bc6086a8b-webhook-cert\") pod \"maas-controller-76cc5b548d-ghw4t\" (UID: \"76784a43-98c6-4e5d-bca7-c43bc6086a8b\") " pod="opendatahub/maas-controller-76cc5b548d-ghw4t"
Jul 27 17:36:55.293101 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.292947    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng4tc\" (UniqueName: \"kubernetes.io/projected/743a17aa-ce64-4fd5-8032-451784fecb0b-kube-api-access-ng4tc\") pod \"maas-controller-d55c76586-wgbrs\" (UID: \"743a17aa-ce64-4fd5-8032-451784fecb0b\") " pod="opendatahub/maas-controller-d55c76586-wgbrs"
Jul 27 17:36:55.293101 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.292976    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4z4q\" (UniqueName: \"kubernetes.io/projected/76784a43-98c6-4e5d-bca7-c43bc6086a8b-kube-api-access-b4z4q\") pod \"maas-controller-76cc5b548d-ghw4t\" (UID: \"76784a43-98c6-4e5d-bca7-c43bc6086a8b\") " pod="opendatahub/maas-controller-76cc5b548d-ghw4t"
Jul 27 17:36:55.295347 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.295323    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76784a43-98c6-4e5d-bca7-c43bc6086a8b-webhook-cert\") pod \"maas-controller-76cc5b548d-ghw4t\" (UID: \"76784a43-98c6-4e5d-bca7-c43bc6086a8b\") " pod="opendatahub/maas-controller-76cc5b548d-ghw4t"
Jul 27 17:36:55.301923 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.301878    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4z4q\" (UniqueName: \"kubernetes.io/projected/76784a43-98c6-4e5d-bca7-c43bc6086a8b-kube-api-access-b4z4q\") pod \"maas-controller-76cc5b548d-ghw4t\" (UID: \"76784a43-98c6-4e5d-bca7-c43bc6086a8b\") " pod="opendatahub/maas-controller-76cc5b548d-ghw4t"
Jul 27 17:36:55.394220 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.394188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng4tc\" (UniqueName: \"kubernetes.io/projected/743a17aa-ce64-4fd5-8032-451784fecb0b-kube-api-access-ng4tc\") pod \"maas-controller-d55c76586-wgbrs\" (UID: \"743a17aa-ce64-4fd5-8032-451784fecb0b\") " pod="opendatahub/maas-controller-d55c76586-wgbrs"
Jul 27 17:36:55.394415 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.394253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/743a17aa-ce64-4fd5-8032-451784fecb0b-webhook-cert\") pod \"maas-controller-d55c76586-wgbrs\" (UID: \"743a17aa-ce64-4fd5-8032-451784fecb0b\") " pod="opendatahub/maas-controller-d55c76586-wgbrs"
Jul 27 17:36:55.396510 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.396482    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/743a17aa-ce64-4fd5-8032-451784fecb0b-webhook-cert\") pod \"maas-controller-d55c76586-wgbrs\" (UID: \"743a17aa-ce64-4fd5-8032-451784fecb0b\") " pod="opendatahub/maas-controller-d55c76586-wgbrs"
Jul 27 17:36:55.402123 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.402081    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76cc5b548d-ghw4t"
Jul 27 17:36:55.403015 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.402995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng4tc\" (UniqueName: \"kubernetes.io/projected/743a17aa-ce64-4fd5-8032-451784fecb0b-kube-api-access-ng4tc\") pod \"maas-controller-d55c76586-wgbrs\" (UID: \"743a17aa-ce64-4fd5-8032-451784fecb0b\") " pod="opendatahub/maas-controller-d55c76586-wgbrs"
Jul 27 17:36:55.509547 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.509516    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d55c76586-wgbrs"
Jul 27 17:36:55.552138 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.552113    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76cc5b548d-ghw4t"]
Jul 27 17:36:55.554512 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:36:55.554477    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76784a43_98c6_4e5d_bca7_c43bc6086a8b.slice/crio-9cf6333dd3131cde2395d99eca42af7f783984413514df2d9be14a7ea3b874ed WatchSource:0}: Error finding container 9cf6333dd3131cde2395d99eca42af7f783984413514df2d9be14a7ea3b874ed: Status 404 returned error can't find the container with id 9cf6333dd3131cde2395d99eca42af7f783984413514df2d9be14a7ea3b874ed
Jul 27 17:36:55.659925 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:55.659834    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d55c76586-wgbrs"]
Jul 27 17:36:55.662190 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:36:55.662163    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod743a17aa_ce64_4fd5_8032_451784fecb0b.slice/crio-afa5284500d60465ec537f60f68036a44a02599b2af8c0e0b023b5d8104acb12 WatchSource:0}: Error finding container afa5284500d60465ec537f60f68036a44a02599b2af8c0e0b023b5d8104acb12: Status 404 returned error can't find the container with id afa5284500d60465ec537f60f68036a44a02599b2af8c0e0b023b5d8104acb12
Jul 27 17:36:56.422336 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:56.422297    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d55c76586-wgbrs" event={"ID":"743a17aa-ce64-4fd5-8032-451784fecb0b","Type":"ContainerStarted","Data":"afa5284500d60465ec537f60f68036a44a02599b2af8c0e0b023b5d8104acb12"}
Jul 27 17:36:56.423962 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:56.423917    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76cc5b548d-ghw4t" event={"ID":"76784a43-98c6-4e5d-bca7-c43bc6086a8b","Type":"ContainerStarted","Data":"9cf6333dd3131cde2395d99eca42af7f783984413514df2d9be14a7ea3b874ed"}
Jul 27 17:36:59.441059 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:59.441014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d55c76586-wgbrs" event={"ID":"743a17aa-ce64-4fd5-8032-451784fecb0b","Type":"ContainerStarted","Data":"ae13c9f9dce559b45ba525dbd1a3eb247376a418acdabb45a07e50225c88b746"}
Jul 27 17:36:59.441510 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:59.441088    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d55c76586-wgbrs"
Jul 27 17:36:59.442480 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:59.442456    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76cc5b548d-ghw4t" event={"ID":"76784a43-98c6-4e5d-bca7-c43bc6086a8b","Type":"ContainerStarted","Data":"a042dca3ff479587ed1cf612aa19a294da472cfbff45019a2c20cd6bec2f1ff1"}
Jul 27 17:36:59.442612 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:59.442574    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76cc5b548d-ghw4t"
Jul 27 17:36:59.462284 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:59.462242    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d55c76586-wgbrs" podStartSLOduration=1.452888589 podStartE2EDuration="4.462228472s" totalImagesPullingTime="3.009339883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:36:59.461367729 +0000 UTC m=+762.476034172" watchObservedRunningTime="2026-07-27 17:36:59.462228472 +0000 UTC m=+762.476894916"
Jul 27 17:36:59.480423 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:36:59.480372    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76cc5b548d-ghw4t" podStartSLOduration=2.363950025 podStartE2EDuration="5.480354387s" totalImagesPullingTime="3.116404362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:36:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:36:59.478785993 +0000 UTC m=+762.493452439" watchObservedRunningTime="2026-07-27 17:36:59.480354387 +0000 UTC m=+762.495020834"
Jul 27 17:37:10.448978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:10.448943    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76cc5b548d-ghw4t"
Jul 27 17:37:10.449387 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:10.449046    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d55c76586-wgbrs"
Jul 27 17:37:10.509655 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:10.509613    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76cc5b548d-ghw4t"]
Jul 27 17:37:10.509846 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:10.509802    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76cc5b548d-ghw4t" podUID="76784a43-98c6-4e5d-bca7-c43bc6086a8b" containerName="manager" containerID="cri-o://a042dca3ff479587ed1cf612aa19a294da472cfbff45019a2c20cd6bec2f1ff1" gracePeriod=30
Jul 27 17:37:10.759536 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:10.759506    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76cc5b548d-ghw4t"
Jul 27 17:37:10.832716 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:10.832684    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76784a43-98c6-4e5d-bca7-c43bc6086a8b-webhook-cert\") pod \"76784a43-98c6-4e5d-bca7-c43bc6086a8b\" (UID: \"76784a43-98c6-4e5d-bca7-c43bc6086a8b\") "
Jul 27 17:37:10.832865 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:10.832756    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4z4q\" (UniqueName: \"kubernetes.io/projected/76784a43-98c6-4e5d-bca7-c43bc6086a8b-kube-api-access-b4z4q\") pod \"76784a43-98c6-4e5d-bca7-c43bc6086a8b\" (UID: \"76784a43-98c6-4e5d-bca7-c43bc6086a8b\") "
Jul 27 17:37:10.834913 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:10.834885    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76784a43-98c6-4e5d-bca7-c43bc6086a8b-kube-api-access-b4z4q" (OuterVolumeSpecName: "kube-api-access-b4z4q") pod "76784a43-98c6-4e5d-bca7-c43bc6086a8b" (UID: "76784a43-98c6-4e5d-bca7-c43bc6086a8b"). InnerVolumeSpecName "kube-api-access-b4z4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:37:10.834913 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:10.834904    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76784a43-98c6-4e5d-bca7-c43bc6086a8b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "76784a43-98c6-4e5d-bca7-c43bc6086a8b" (UID: "76784a43-98c6-4e5d-bca7-c43bc6086a8b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:37:10.933627 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:10.933572    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76784a43-98c6-4e5d-bca7-c43bc6086a8b-webhook-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:37:10.933627 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:10.933625    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4z4q\" (UniqueName: \"kubernetes.io/projected/76784a43-98c6-4e5d-bca7-c43bc6086a8b-kube-api-access-b4z4q\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:37:11.498238 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:11.498209    2580 generic.go:356] "Generic (PLEG): container finished" podID="76784a43-98c6-4e5d-bca7-c43bc6086a8b" containerID="a042dca3ff479587ed1cf612aa19a294da472cfbff45019a2c20cd6bec2f1ff1" exitCode=0
Jul 27 17:37:11.498602 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:11.498251    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76cc5b548d-ghw4t"
Jul 27 17:37:11.498602 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:11.498300    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76cc5b548d-ghw4t" event={"ID":"76784a43-98c6-4e5d-bca7-c43bc6086a8b","Type":"ContainerDied","Data":"a042dca3ff479587ed1cf612aa19a294da472cfbff45019a2c20cd6bec2f1ff1"}
Jul 27 17:37:11.498602 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:11.498348    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76cc5b548d-ghw4t" event={"ID":"76784a43-98c6-4e5d-bca7-c43bc6086a8b","Type":"ContainerDied","Data":"9cf6333dd3131cde2395d99eca42af7f783984413514df2d9be14a7ea3b874ed"}
Jul 27 17:37:11.498602 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:11.498370    2580 scope.go:117] "RemoveContainer" containerID="a042dca3ff479587ed1cf612aa19a294da472cfbff45019a2c20cd6bec2f1ff1"
Jul 27 17:37:11.506615 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:11.506568    2580 scope.go:117] "RemoveContainer" containerID="a042dca3ff479587ed1cf612aa19a294da472cfbff45019a2c20cd6bec2f1ff1"
Jul 27 17:37:11.506862 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:37:11.506842    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a042dca3ff479587ed1cf612aa19a294da472cfbff45019a2c20cd6bec2f1ff1\": container with ID starting with a042dca3ff479587ed1cf612aa19a294da472cfbff45019a2c20cd6bec2f1ff1 not found: ID does not exist" containerID="a042dca3ff479587ed1cf612aa19a294da472cfbff45019a2c20cd6bec2f1ff1"
Jul 27 17:37:11.506924 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:11.506872    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a042dca3ff479587ed1cf612aa19a294da472cfbff45019a2c20cd6bec2f1ff1"} err="failed to get container status \"a042dca3ff479587ed1cf612aa19a294da472cfbff45019a2c20cd6bec2f1ff1\": rpc error: code = NotFound desc = could not find container \"a042dca3ff479587ed1cf612aa19a294da472cfbff45019a2c20cd6bec2f1ff1\": container with ID starting with a042dca3ff479587ed1cf612aa19a294da472cfbff45019a2c20cd6bec2f1ff1 not found: ID does not exist"
Jul 27 17:37:11.515793 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:11.515770    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76cc5b548d-ghw4t"]
Jul 27 17:37:11.517251 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:11.517231    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76cc5b548d-ghw4t"]
Jul 27 17:37:13.476452 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:13.476411    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76784a43-98c6-4e5d-bca7-c43bc6086a8b" path="/var/lib/kubelet/pods/76784a43-98c6-4e5d-bca7-c43bc6086a8b/volumes"
Jul 27 17:37:32.308275 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.308237    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7665887c99-kdzhk"]
Jul 27 17:37:32.308775 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.308602    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76784a43-98c6-4e5d-bca7-c43bc6086a8b" containerName="manager"
Jul 27 17:37:32.308775 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.308618    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="76784a43-98c6-4e5d-bca7-c43bc6086a8b" containerName="manager"
Jul 27 17:37:32.308775 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.308688    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="76784a43-98c6-4e5d-bca7-c43bc6086a8b" containerName="manager"
Jul 27 17:37:32.316976 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.316957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7665887c99-kdzhk"
Jul 27 17:37:32.319396 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.319374    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 27 17:37:32.319538 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.319456    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sgjmp\""
Jul 27 17:37:32.323077 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.323056    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7665887c99-kdzhk"]
Jul 27 17:37:32.409499 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.409457    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnhrj\" (UniqueName: \"kubernetes.io/projected/02809fa5-170d-493c-9735-e1d521f09737-kube-api-access-bnhrj\") pod \"maas-api-7665887c99-kdzhk\" (UID: \"02809fa5-170d-493c-9735-e1d521f09737\") " pod="odh-ai-gateway-infra/maas-api-7665887c99-kdzhk"
Jul 27 17:37:32.409690 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.409532    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02809fa5-170d-493c-9735-e1d521f09737-openshift-service-ca\") pod \"maas-api-7665887c99-kdzhk\" (UID: \"02809fa5-170d-493c-9735-e1d521f09737\") " pod="odh-ai-gateway-infra/maas-api-7665887c99-kdzhk"
Jul 27 17:37:32.409690 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.409608    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02809fa5-170d-493c-9735-e1d521f09737-maas-api-tls\") pod \"maas-api-7665887c99-kdzhk\" (UID: \"02809fa5-170d-493c-9735-e1d521f09737\") " pod="odh-ai-gateway-infra/maas-api-7665887c99-kdzhk"
Jul 27 17:37:32.510225 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.510186    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02809fa5-170d-493c-9735-e1d521f09737-openshift-service-ca\") pod \"maas-api-7665887c99-kdzhk\" (UID: \"02809fa5-170d-493c-9735-e1d521f09737\") " pod="odh-ai-gateway-infra/maas-api-7665887c99-kdzhk"
Jul 27 17:37:32.510389 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.510263    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02809fa5-170d-493c-9735-e1d521f09737-maas-api-tls\") pod \"maas-api-7665887c99-kdzhk\" (UID: \"02809fa5-170d-493c-9735-e1d521f09737\") " pod="odh-ai-gateway-infra/maas-api-7665887c99-kdzhk"
Jul 27 17:37:32.510389 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.510307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnhrj\" (UniqueName: \"kubernetes.io/projected/02809fa5-170d-493c-9735-e1d521f09737-kube-api-access-bnhrj\") pod \"maas-api-7665887c99-kdzhk\" (UID: \"02809fa5-170d-493c-9735-e1d521f09737\") " pod="odh-ai-gateway-infra/maas-api-7665887c99-kdzhk"
Jul 27 17:37:32.510965 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.510939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02809fa5-170d-493c-9735-e1d521f09737-openshift-service-ca\") pod \"maas-api-7665887c99-kdzhk\" (UID: \"02809fa5-170d-493c-9735-e1d521f09737\") " pod="odh-ai-gateway-infra/maas-api-7665887c99-kdzhk"
Jul 27 17:37:32.512701 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.512678    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02809fa5-170d-493c-9735-e1d521f09737-maas-api-tls\") pod \"maas-api-7665887c99-kdzhk\" (UID: \"02809fa5-170d-493c-9735-e1d521f09737\") " pod="odh-ai-gateway-infra/maas-api-7665887c99-kdzhk"
Jul 27 17:37:32.521907 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.521885    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnhrj\" (UniqueName: \"kubernetes.io/projected/02809fa5-170d-493c-9735-e1d521f09737-kube-api-access-bnhrj\") pod \"maas-api-7665887c99-kdzhk\" (UID: \"02809fa5-170d-493c-9735-e1d521f09737\") " pod="odh-ai-gateway-infra/maas-api-7665887c99-kdzhk"
Jul 27 17:37:32.631981 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.631893    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7665887c99-kdzhk"
Jul 27 17:37:32.748618 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.748570    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zh5mm"]
Jul 27 17:37:32.754246 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.754222    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zh5mm"
Jul 27 17:37:32.757300 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.757271    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fzmhg\""
Jul 27 17:37:32.757300 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.757298    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 17:37:32.761161 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.761131    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zh5mm"]
Jul 27 17:37:32.783607 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.783562    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7665887c99-kdzhk"]
Jul 27 17:37:32.786615 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:37:32.786573    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02809fa5_170d_493c_9735_e1d521f09737.slice/crio-014c95508e01482269ea95ec0113fa33feca3a611e7d4c9a862b8c576def3e3b WatchSource:0}: Error finding container 014c95508e01482269ea95ec0113fa33feca3a611e7d4c9a862b8c576def3e3b: Status 404 returned error can't find the container with id 014c95508e01482269ea95ec0113fa33feca3a611e7d4c9a862b8c576def3e3b
Jul 27 17:37:32.794902 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.794880    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-r7tcz"]
Jul 27 17:37:32.799043 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.799025    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-r7tcz"
Jul 27 17:37:32.810657 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.810626    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-r7tcz"]
Jul 27 17:37:32.914422 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.914377    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0141a4a1-9e0c-4bc9-886c-96b86eca20a7-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-r7tcz\" (UID: \"0141a4a1-9e0c-4bc9-886c-96b86eca20a7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-r7tcz"
Jul 27 17:37:32.914635 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.914427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89ba1735-b440-4f06-9fba-5754462f04a7-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zh5mm\" (UID: \"89ba1735-b440-4f06-9fba-5754462f04a7\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zh5mm"
Jul 27 17:37:32.914635 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.914461    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn8tx\" (UniqueName: \"kubernetes.io/projected/0141a4a1-9e0c-4bc9-886c-96b86eca20a7-kube-api-access-fn8tx\") pod \"payload-processing-5cc6cd444b-r7tcz\" (UID: \"0141a4a1-9e0c-4bc9-886c-96b86eca20a7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-r7tcz"
Jul 27 17:37:32.914761 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:32.914626    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rps6q\" (UniqueName: \"kubernetes.io/projected/89ba1735-b440-4f06-9fba-5754462f04a7-kube-api-access-rps6q\") pod \"payload-pre-processing-687dbb6cf6-zh5mm\" (UID: \"89ba1735-b440-4f06-9fba-5754462f04a7\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zh5mm"
Jul 27 17:37:33.015745 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:33.015702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rps6q\" (UniqueName: \"kubernetes.io/projected/89ba1735-b440-4f06-9fba-5754462f04a7-kube-api-access-rps6q\") pod \"payload-pre-processing-687dbb6cf6-zh5mm\" (UID: \"89ba1735-b440-4f06-9fba-5754462f04a7\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zh5mm"
Jul 27 17:37:33.016005 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:33.015762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0141a4a1-9e0c-4bc9-886c-96b86eca20a7-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-r7tcz\" (UID: \"0141a4a1-9e0c-4bc9-886c-96b86eca20a7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-r7tcz"
Jul 27 17:37:33.016005 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:33.015795    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89ba1735-b440-4f06-9fba-5754462f04a7-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zh5mm\" (UID: \"89ba1735-b440-4f06-9fba-5754462f04a7\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zh5mm"
Jul 27 17:37:33.016005 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:33.015819    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn8tx\" (UniqueName: \"kubernetes.io/projected/0141a4a1-9e0c-4bc9-886c-96b86eca20a7-kube-api-access-fn8tx\") pod \"payload-processing-5cc6cd444b-r7tcz\" (UID: \"0141a4a1-9e0c-4bc9-886c-96b86eca20a7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-r7tcz"
Jul 27 17:37:33.016509 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:33.016487    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89ba1735-b440-4f06-9fba-5754462f04a7-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zh5mm\" (UID: \"89ba1735-b440-4f06-9fba-5754462f04a7\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zh5mm"
Jul 27 17:37:33.016509 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:33.016501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0141a4a1-9e0c-4bc9-886c-96b86eca20a7-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-r7tcz\" (UID: \"0141a4a1-9e0c-4bc9-886c-96b86eca20a7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-r7tcz"
Jul 27 17:37:33.024092 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:33.024069    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rps6q\" (UniqueName: \"kubernetes.io/projected/89ba1735-b440-4f06-9fba-5754462f04a7-kube-api-access-rps6q\") pod \"payload-pre-processing-687dbb6cf6-zh5mm\" (UID: \"89ba1735-b440-4f06-9fba-5754462f04a7\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zh5mm"
Jul 27 17:37:33.024479 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:33.024463    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn8tx\" (UniqueName: \"kubernetes.io/projected/0141a4a1-9e0c-4bc9-886c-96b86eca20a7-kube-api-access-fn8tx\") pod \"payload-processing-5cc6cd444b-r7tcz\" (UID: \"0141a4a1-9e0c-4bc9-886c-96b86eca20a7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-r7tcz"
Jul 27 17:37:33.067266 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:33.067240    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zh5mm"
Jul 27 17:37:33.110769 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:33.110732    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-r7tcz"
Jul 27 17:37:33.219251 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:33.219172    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zh5mm"]
Jul 27 17:37:33.307473 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:33.307445    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-r7tcz"]
Jul 27 17:37:33.309921 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:37:33.309894    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0141a4a1_9e0c_4bc9_886c_96b86eca20a7.slice/crio-5d15f81477577adef637e402163ecc1172d232c7d73235b8fcc0ce249908f055 WatchSource:0}: Error finding container 5d15f81477577adef637e402163ecc1172d232c7d73235b8fcc0ce249908f055: Status 404 returned error can't find the container with id 5d15f81477577adef637e402163ecc1172d232c7d73235b8fcc0ce249908f055
Jul 27 17:37:33.599880 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:33.599780    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7665887c99-kdzhk" event={"ID":"02809fa5-170d-493c-9735-e1d521f09737","Type":"ContainerStarted","Data":"014c95508e01482269ea95ec0113fa33feca3a611e7d4c9a862b8c576def3e3b"}
Jul 27 17:37:33.601295 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:33.601261    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zh5mm" event={"ID":"89ba1735-b440-4f06-9fba-5754462f04a7","Type":"ContainerStarted","Data":"424d76c41f87f22a1e769d0d0e4fcf51263536265b0bed8150bc4ac1e8fcf9fb"}
Jul 27 17:37:33.602643 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:33.602606    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-r7tcz" event={"ID":"0141a4a1-9e0c-4bc9-886c-96b86eca20a7","Type":"ContainerStarted","Data":"5d15f81477577adef637e402163ecc1172d232c7d73235b8fcc0ce249908f055"}
Jul 27 17:37:35.616564 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:35.616525    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7665887c99-kdzhk" event={"ID":"02809fa5-170d-493c-9735-e1d521f09737","Type":"ContainerStarted","Data":"3513b9a121f15637992a38554ff0ee5806c8589d0af898093dfe4344b9c2ce7b"}
Jul 27 17:37:35.617050 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:35.616684    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7665887c99-kdzhk"
Jul 27 17:37:35.657605 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:35.639786    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7665887c99-kdzhk" podStartSLOduration=1.651868962 podStartE2EDuration="3.639766136s" totalImagesPullingTime="1.987897174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:37:35.63684957 +0000 UTC m=+798.651516026" watchObservedRunningTime="2026-07-27 17:37:35.639766136 +0000 UTC m=+798.654432584"
Jul 27 17:37:36.622776 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:36.622727    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-r7tcz" event={"ID":"0141a4a1-9e0c-4bc9-886c-96b86eca20a7","Type":"ContainerStarted","Data":"4e7d41ad74b7bc7779ec63072f67df3fb82f01be57414855440cec862f9f3087"}
Jul 27 17:37:36.623276 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:36.622843    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-r7tcz"
Jul 27 17:37:36.624286 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:36.624255    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zh5mm" event={"ID":"89ba1735-b440-4f06-9fba-5754462f04a7","Type":"ContainerStarted","Data":"97a8f10dfc8efd7ee75cac14b78346933063b040af25ccf98354c5a3c4bb30a0"}
Jul 27 17:37:36.624399 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:36.624380    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zh5mm"
Jul 27 17:37:36.643611 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:36.641367    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-r7tcz" podStartSLOduration=2.022011787 podStartE2EDuration="4.641346746s" totalImagesPullingTime="2.619334959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:37:36.639166691 +0000 UTC m=+799.653833135" watchObservedRunningTime="2026-07-27 17:37:36.641346746 +0000 UTC m=+799.656013171"
Jul 27 17:37:36.658496 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:36.658446    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zh5mm" podStartSLOduration=2.170618794 podStartE2EDuration="4.65841155s" totalImagesPullingTime="2.487792756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:37:36.656904289 +0000 UTC m=+799.671570735" watchObservedRunningTime="2026-07-27 17:37:36.65841155 +0000 UTC m=+799.673077996"
Jul 27 17:37:40.646393 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:40.646314    2580 generic.go:356] "Generic (PLEG): container finished" podID="dd61f14c-29e5-462e-b781-2068d16ab91b" containerID="c4f0a0b4dfe9bb14d5a3cd224a7a75d2731b9f219fbe943dea2aad97e9ed4b94" exitCode=0
Jul 27 17:37:40.646803 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:40.646387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz" event={"ID":"dd61f14c-29e5-462e-b781-2068d16ab91b","Type":"ContainerDied","Data":"c4f0a0b4dfe9bb14d5a3cd224a7a75d2731b9f219fbe943dea2aad97e9ed4b94"}
Jul 27 17:37:40.646803 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:40.646788    2580 scope.go:117] "RemoveContainer" containerID="c4f0a0b4dfe9bb14d5a3cd224a7a75d2731b9f219fbe943dea2aad97e9ed4b94"
Jul 27 17:37:40.647758 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:40.647727    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:37:40.647832 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:40.647814    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:37:40.647882 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:40.647866    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:37:41.630067 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:41.630040    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7665887c99-kdzhk"
Jul 27 17:37:41.681674 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:41.681642    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz" event={"ID":"dd61f14c-29e5-462e-b781-2068d16ab91b","Type":"ContainerStarted","Data":"603d186b50191c2df32e19e8067a68ba4aa75e0382330b6ecfebb00f9f3423f7"}
Jul 27 17:37:42.030123 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:42.030080    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:37:42.031391 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:42.031361    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-m99fz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 27 17:37:42.031531 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:42.031415    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz" podUID="dd61f14c-29e5-462e-b781-2068d16ab91b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 27 17:37:43.029720 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:43.029684    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-m99fz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 27 17:37:43.030116 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:43.029744    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz" podUID="dd61f14c-29e5-462e-b781-2068d16ab91b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 27 17:37:44.030065 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:44.030027    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-m99fz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 27 17:37:44.030455 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:44.030088    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz" podUID="dd61f14c-29e5-462e-b781-2068d16ab91b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 27 17:37:45.030240 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:45.030204    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-m99fz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 27 17:37:45.030641 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:45.030265    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz" podUID="dd61f14c-29e5-462e-b781-2068d16ab91b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 27 17:37:45.181287 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:45.181254    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:37:46.034110 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:46.034080    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:37:46.035103 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:46.035081    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-m99fz"
Jul 27 17:37:47.631902 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:47.631874    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-r7tcz"
Jul 27 17:37:47.632296 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:47.631942    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zh5mm"
Jul 27 17:37:53.583263 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.583223    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"]
Jul 27 17:37:53.586948 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.586926    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.589686 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.589667    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 17:37:53.589802 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.589666    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 27 17:37:53.589802 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.589665    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-khxw9\""
Jul 27 17:37:53.589802 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.589711    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 17:37:53.597907 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.597884    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"]
Jul 27 17:37:53.606565 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.606543    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9535367d-9814-481b-a805-ff3c8e1990a4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.606703 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.606602    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9535367d-9814-481b-a805-ff3c8e1990a4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.606703 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.606637    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9535367d-9814-481b-a805-ff3c8e1990a4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.606703 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.606661    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9535367d-9814-481b-a805-ff3c8e1990a4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.606818 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.606704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtf96\" (UniqueName: \"kubernetes.io/projected/9535367d-9814-481b-a805-ff3c8e1990a4-kube-api-access-wtf96\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.606818 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.606744    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9535367d-9814-481b-a805-ff3c8e1990a4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.707937 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.707906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9535367d-9814-481b-a805-ff3c8e1990a4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.708114 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.707959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9535367d-9814-481b-a805-ff3c8e1990a4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.708114 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.707998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9535367d-9814-481b-a805-ff3c8e1990a4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.708114 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.708024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9535367d-9814-481b-a805-ff3c8e1990a4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.708114 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.708059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9535367d-9814-481b-a805-ff3c8e1990a4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.708334 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.708116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtf96\" (UniqueName: \"kubernetes.io/projected/9535367d-9814-481b-a805-ff3c8e1990a4-kube-api-access-wtf96\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.708484 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.708454    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9535367d-9814-481b-a805-ff3c8e1990a4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.708484 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.708473    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9535367d-9814-481b-a805-ff3c8e1990a4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.708763 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.708526    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9535367d-9814-481b-a805-ff3c8e1990a4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.710222 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.710191    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9535367d-9814-481b-a805-ff3c8e1990a4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.710805 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.710785    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9535367d-9814-481b-a805-ff3c8e1990a4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.716914 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.716892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtf96\" (UniqueName: \"kubernetes.io/projected/9535367d-9814-481b-a805-ff3c8e1990a4-kube-api-access-wtf96\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn\" (UID: \"9535367d-9814-481b-a805-ff3c8e1990a4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:53.898646 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:53.898541    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:37:54.049984 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:54.049821    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"]
Jul 27 17:37:54.052326 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:37:54.052295    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9535367d_9814_481b_a805_ff3c8e1990a4.slice/crio-01747433413dfdc9f26f3d3e566d6050fb4d5a01daafa132b2f9b4cc46d554a8 WatchSource:0}: Error finding container 01747433413dfdc9f26f3d3e566d6050fb4d5a01daafa132b2f9b4cc46d554a8: Status 404 returned error can't find the container with id 01747433413dfdc9f26f3d3e566d6050fb4d5a01daafa132b2f9b4cc46d554a8
Jul 27 17:37:54.742980 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:54.742941    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn" event={"ID":"9535367d-9814-481b-a805-ff3c8e1990a4","Type":"ContainerStarted","Data":"01747433413dfdc9f26f3d3e566d6050fb4d5a01daafa132b2f9b4cc46d554a8"}
Jul 27 17:37:55.749920 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:55.749886    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn" event={"ID":"9535367d-9814-481b-a805-ff3c8e1990a4","Type":"ContainerStarted","Data":"5c4ddc8125e6a614455f555ab2f7fefa8e8dfaebde3de460c7b5814f268b58fa"}
Jul 27 17:37:55.769280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:37:55.769224    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn" podStartSLOduration=1.552399911 podStartE2EDuration="2.769204747s" totalImagesPullingTime="1.216804836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:37:55.767338189 +0000 UTC m=+818.782004636" watchObservedRunningTime="2026-07-27 17:37:55.769204747 +0000 UTC m=+818.783871191"
Jul 27 17:38:03.898819 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:03.898785    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:38:03.899304 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:03.898870    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:38:03.911295 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:03.911271    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:38:04.802555 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:04.802527    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn"
Jul 27 17:38:16.189542 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.189511    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"]
Jul 27 17:38:16.193283 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.193262    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.196213 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.196192    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 27 17:38:16.204633 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.204609    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"]
Jul 27 17:38:16.277878 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.277837    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.277878 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.277884    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.278096 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.277904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqpxs\" (UniqueName: \"kubernetes.io/projected/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-kube-api-access-nqpxs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.278096 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.277965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.278096 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.277980    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.278096 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.278039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.378650 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.378609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.378855 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.378709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.378855 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.378741    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.378855 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.378765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqpxs\" (UniqueName: \"kubernetes.io/projected/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-kube-api-access-nqpxs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.378855 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.378806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.378855 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.378821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.379153 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.379081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.379153 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.379117    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.379153 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.379149    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.381052 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.381027    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.381247 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.381230    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.386479 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.386452    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqpxs\" (UniqueName: \"kubernetes.io/projected/c7cd0507-005f-4c93-b2fa-2175ebf25c1b-kube-api-access-nqpxs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-r5ck8\" (UID: \"c7cd0507-005f-4c93-b2fa-2175ebf25c1b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.506341 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.506250    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:16.638697 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.638673    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"]
Jul 27 17:38:16.641341 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:38:16.641301    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7cd0507_005f_4c93_b2fa_2175ebf25c1b.slice/crio-30e039b4238935dffb2e991ce440c7c44ab7f2d77b48776287f4948e98290424 WatchSource:0}: Error finding container 30e039b4238935dffb2e991ce440c7c44ab7f2d77b48776287f4948e98290424: Status 404 returned error can't find the container with id 30e039b4238935dffb2e991ce440c7c44ab7f2d77b48776287f4948e98290424
Jul 27 17:38:16.850530 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:16.850455    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8" event={"ID":"c7cd0507-005f-4c93-b2fa-2175ebf25c1b","Type":"ContainerStarted","Data":"30e039b4238935dffb2e991ce440c7c44ab7f2d77b48776287f4948e98290424"}
Jul 27 17:38:17.856470 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:17.856429    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8" event={"ID":"c7cd0507-005f-4c93-b2fa-2175ebf25c1b","Type":"ContainerStarted","Data":"8a744eca704bc01b46e4e1078603c91a5c88eb017151d2f4f2b838bd013793b9"}
Jul 27 17:38:17.879063 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:17.879000    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8" podStartSLOduration=1.658123377 podStartE2EDuration="1.878978093s" totalImagesPullingTime="220.854716ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:38:17.876803426 +0000 UTC m=+840.891469871" watchObservedRunningTime="2026-07-27 17:38:17.878978093 +0000 UTC m=+840.893644539"
Jul 27 17:38:26.507157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:26.507106    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:26.507560 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:26.507191    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:26.520260 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:26.520226    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:38:26.910807 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:38:26.910782    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-r5ck8"
Jul 27 17:39:53.770083 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:53.770042    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b7cfb4cc-nhj8h"]
Jul 27 17:39:53.770570 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:53.770282    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5b7cfb4cc-nhj8h" podUID="86a4683d-c29c-49a1-ab98-98b29e3ff09a" containerName="authorino" containerID="cri-o://781da857054bd7889b730e828b603ebbbf76608cc6ac647e45f4c3d3e3119823" gracePeriod=30
Jul 27 17:39:54.026919 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:54.026856    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b7cfb4cc-nhj8h"
Jul 27 17:39:54.136833 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:54.136804    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6dct\" (UniqueName: \"kubernetes.io/projected/86a4683d-c29c-49a1-ab98-98b29e3ff09a-kube-api-access-z6dct\") pod \"86a4683d-c29c-49a1-ab98-98b29e3ff09a\" (UID: \"86a4683d-c29c-49a1-ab98-98b29e3ff09a\") "
Jul 27 17:39:54.136833 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:54.136840    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/86a4683d-c29c-49a1-ab98-98b29e3ff09a-tls-cert\") pod \"86a4683d-c29c-49a1-ab98-98b29e3ff09a\" (UID: \"86a4683d-c29c-49a1-ab98-98b29e3ff09a\") "
Jul 27 17:39:54.138699 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:54.138664    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86a4683d-c29c-49a1-ab98-98b29e3ff09a-kube-api-access-z6dct" (OuterVolumeSpecName: "kube-api-access-z6dct") pod "86a4683d-c29c-49a1-ab98-98b29e3ff09a" (UID: "86a4683d-c29c-49a1-ab98-98b29e3ff09a"). InnerVolumeSpecName "kube-api-access-z6dct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:39:54.148972 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:54.148945    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86a4683d-c29c-49a1-ab98-98b29e3ff09a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "86a4683d-c29c-49a1-ab98-98b29e3ff09a" (UID: "86a4683d-c29c-49a1-ab98-98b29e3ff09a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:39:54.237760 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:54.237728    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6dct\" (UniqueName: \"kubernetes.io/projected/86a4683d-c29c-49a1-ab98-98b29e3ff09a-kube-api-access-z6dct\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:39:54.237760 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:54.237754    2580 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/86a4683d-c29c-49a1-ab98-98b29e3ff09a-tls-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:39:54.304549 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:54.304479    2580 generic.go:356] "Generic (PLEG): container finished" podID="86a4683d-c29c-49a1-ab98-98b29e3ff09a" containerID="781da857054bd7889b730e828b603ebbbf76608cc6ac647e45f4c3d3e3119823" exitCode=0
Jul 27 17:39:54.304549 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:54.304520    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b7cfb4cc-nhj8h"
Jul 27 17:39:54.304549 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:54.304540    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b7cfb4cc-nhj8h" event={"ID":"86a4683d-c29c-49a1-ab98-98b29e3ff09a","Type":"ContainerDied","Data":"781da857054bd7889b730e828b603ebbbf76608cc6ac647e45f4c3d3e3119823"}
Jul 27 17:39:54.304763 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:54.304607    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b7cfb4cc-nhj8h" event={"ID":"86a4683d-c29c-49a1-ab98-98b29e3ff09a","Type":"ContainerDied","Data":"e03a96740584499ed584d1b535937c5b106c83c66f33b7875aa23f0adb9a2be8"}
Jul 27 17:39:54.304763 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:54.304632    2580 scope.go:117] "RemoveContainer" containerID="781da857054bd7889b730e828b603ebbbf76608cc6ac647e45f4c3d3e3119823"
Jul 27 17:39:54.313339 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:54.313322    2580 scope.go:117] "RemoveContainer" containerID="781da857054bd7889b730e828b603ebbbf76608cc6ac647e45f4c3d3e3119823"
Jul 27 17:39:54.313644 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:39:54.313570    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"781da857054bd7889b730e828b603ebbbf76608cc6ac647e45f4c3d3e3119823\": container with ID starting with 781da857054bd7889b730e828b603ebbbf76608cc6ac647e45f4c3d3e3119823 not found: ID does not exist" containerID="781da857054bd7889b730e828b603ebbbf76608cc6ac647e45f4c3d3e3119823"
Jul 27 17:39:54.313714 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:54.313653    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"781da857054bd7889b730e828b603ebbbf76608cc6ac647e45f4c3d3e3119823"} err="failed to get container status \"781da857054bd7889b730e828b603ebbbf76608cc6ac647e45f4c3d3e3119823\": rpc error: code = NotFound desc = could not find container \"781da857054bd7889b730e828b603ebbbf76608cc6ac647e45f4c3d3e3119823\": container with ID starting with 781da857054bd7889b730e828b603ebbbf76608cc6ac647e45f4c3d3e3119823 not found: ID does not exist"
Jul 27 17:39:54.325230 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:54.325207    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b7cfb4cc-nhj8h"]
Jul 27 17:39:54.327486 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:54.327465    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b7cfb4cc-nhj8h"]
Jul 27 17:39:55.477393 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:39:55.477363    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86a4683d-c29c-49a1-ab98-98b29e3ff09a" path="/var/lib/kubelet/pods/86a4683d-c29c-49a1-ab98-98b29e3ff09a/volumes"
Jul 27 17:40:38.437508 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:38.437474    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d55c76586-wgbrs"]
Jul 27 17:40:38.438120 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:38.437674    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-d55c76586-wgbrs" podUID="743a17aa-ce64-4fd5-8032-451784fecb0b" containerName="manager" containerID="cri-o://ae13c9f9dce559b45ba525dbd1a3eb247376a418acdabb45a07e50225c88b746" gracePeriod=30
Jul 27 17:40:38.686500 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:38.686475    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d55c76586-wgbrs"
Jul 27 17:40:38.720605 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:38.720519    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/743a17aa-ce64-4fd5-8032-451784fecb0b-webhook-cert\") pod \"743a17aa-ce64-4fd5-8032-451784fecb0b\" (UID: \"743a17aa-ce64-4fd5-8032-451784fecb0b\") "
Jul 27 17:40:38.720748 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:38.720612    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng4tc\" (UniqueName: \"kubernetes.io/projected/743a17aa-ce64-4fd5-8032-451784fecb0b-kube-api-access-ng4tc\") pod \"743a17aa-ce64-4fd5-8032-451784fecb0b\" (UID: \"743a17aa-ce64-4fd5-8032-451784fecb0b\") "
Jul 27 17:40:38.723151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:38.723120    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/743a17aa-ce64-4fd5-8032-451784fecb0b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "743a17aa-ce64-4fd5-8032-451784fecb0b" (UID: "743a17aa-ce64-4fd5-8032-451784fecb0b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:40:38.723151 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:38.723134    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/743a17aa-ce64-4fd5-8032-451784fecb0b-kube-api-access-ng4tc" (OuterVolumeSpecName: "kube-api-access-ng4tc") pod "743a17aa-ce64-4fd5-8032-451784fecb0b" (UID: "743a17aa-ce64-4fd5-8032-451784fecb0b"). InnerVolumeSpecName "kube-api-access-ng4tc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:40:38.821755 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:38.821722    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/743a17aa-ce64-4fd5-8032-451784fecb0b-webhook-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:40:38.821755 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:38.821750    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng4tc\" (UniqueName: \"kubernetes.io/projected/743a17aa-ce64-4fd5-8032-451784fecb0b-kube-api-access-ng4tc\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:40:39.519566 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:39.519530    2580 generic.go:356] "Generic (PLEG): container finished" podID="743a17aa-ce64-4fd5-8032-451784fecb0b" containerID="ae13c9f9dce559b45ba525dbd1a3eb247376a418acdabb45a07e50225c88b746" exitCode=0
Jul 27 17:40:39.519912 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:39.519570    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d55c76586-wgbrs"
Jul 27 17:40:39.519912 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:39.519613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d55c76586-wgbrs" event={"ID":"743a17aa-ce64-4fd5-8032-451784fecb0b","Type":"ContainerDied","Data":"ae13c9f9dce559b45ba525dbd1a3eb247376a418acdabb45a07e50225c88b746"}
Jul 27 17:40:39.519912 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:39.519664    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d55c76586-wgbrs" event={"ID":"743a17aa-ce64-4fd5-8032-451784fecb0b","Type":"ContainerDied","Data":"afa5284500d60465ec537f60f68036a44a02599b2af8c0e0b023b5d8104acb12"}
Jul 27 17:40:39.519912 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:39.519690    2580 scope.go:117] "RemoveContainer" containerID="ae13c9f9dce559b45ba525dbd1a3eb247376a418acdabb45a07e50225c88b746"
Jul 27 17:40:39.528273 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:39.528255    2580 scope.go:117] "RemoveContainer" containerID="ae13c9f9dce559b45ba525dbd1a3eb247376a418acdabb45a07e50225c88b746"
Jul 27 17:40:39.528515 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:40:39.528499    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae13c9f9dce559b45ba525dbd1a3eb247376a418acdabb45a07e50225c88b746\": container with ID starting with ae13c9f9dce559b45ba525dbd1a3eb247376a418acdabb45a07e50225c88b746 not found: ID does not exist" containerID="ae13c9f9dce559b45ba525dbd1a3eb247376a418acdabb45a07e50225c88b746"
Jul 27 17:40:39.528561 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:39.528522    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae13c9f9dce559b45ba525dbd1a3eb247376a418acdabb45a07e50225c88b746"} err="failed to get container status \"ae13c9f9dce559b45ba525dbd1a3eb247376a418acdabb45a07e50225c88b746\": rpc error: code = NotFound desc = could not find container \"ae13c9f9dce559b45ba525dbd1a3eb247376a418acdabb45a07e50225c88b746\": container with ID starting with ae13c9f9dce559b45ba525dbd1a3eb247376a418acdabb45a07e50225c88b746 not found: ID does not exist"
Jul 27 17:40:39.537996 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:39.537975    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d55c76586-wgbrs"]
Jul 27 17:40:39.540853 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:39.540834    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d55c76586-wgbrs"]
Jul 27 17:40:41.477231 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:40:41.477199    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="743a17aa-ce64-4fd5-8032-451784fecb0b" path="/var/lib/kubelet/pods/743a17aa-ce64-4fd5-8032-451784fecb0b/volumes"
Jul 27 17:41:40.333555 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.333520    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d55c76586-4xd57"]
Jul 27 17:41:40.334042 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.333921    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="743a17aa-ce64-4fd5-8032-451784fecb0b" containerName="manager"
Jul 27 17:41:40.334042 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.333934    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="743a17aa-ce64-4fd5-8032-451784fecb0b" containerName="manager"
Jul 27 17:41:40.334042 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.333950    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86a4683d-c29c-49a1-ab98-98b29e3ff09a" containerName="authorino"
Jul 27 17:41:40.334042 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.333957    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="86a4683d-c29c-49a1-ab98-98b29e3ff09a" containerName="authorino"
Jul 27 17:41:40.334042 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.334009    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="86a4683d-c29c-49a1-ab98-98b29e3ff09a" containerName="authorino"
Jul 27 17:41:40.334042 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.334023    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="743a17aa-ce64-4fd5-8032-451784fecb0b" containerName="manager"
Jul 27 17:41:40.338116 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.338099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d55c76586-4xd57"
Jul 27 17:41:40.342132 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.342108    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z8v8w\""
Jul 27 17:41:40.342317 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.342148    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 17:41:40.342407 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.342254    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 17:41:40.345118 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.345094    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d55c76586-4xd57"]
Jul 27 17:41:40.456550 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.456506    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/662869a0-e212-493d-940a-913af15e7cc6-webhook-cert\") pod \"maas-controller-d55c76586-4xd57\" (UID: \"662869a0-e212-493d-940a-913af15e7cc6\") " pod="opendatahub/maas-controller-d55c76586-4xd57"
Jul 27 17:41:40.456742 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.456616    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8srjm\" (UniqueName: \"kubernetes.io/projected/662869a0-e212-493d-940a-913af15e7cc6-kube-api-access-8srjm\") pod \"maas-controller-d55c76586-4xd57\" (UID: \"662869a0-e212-493d-940a-913af15e7cc6\") " pod="opendatahub/maas-controller-d55c76586-4xd57"
Jul 27 17:41:40.557755 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.557722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/662869a0-e212-493d-940a-913af15e7cc6-webhook-cert\") pod \"maas-controller-d55c76586-4xd57\" (UID: \"662869a0-e212-493d-940a-913af15e7cc6\") " pod="opendatahub/maas-controller-d55c76586-4xd57"
Jul 27 17:41:40.557934 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.557799    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8srjm\" (UniqueName: \"kubernetes.io/projected/662869a0-e212-493d-940a-913af15e7cc6-kube-api-access-8srjm\") pod \"maas-controller-d55c76586-4xd57\" (UID: \"662869a0-e212-493d-940a-913af15e7cc6\") " pod="opendatahub/maas-controller-d55c76586-4xd57"
Jul 27 17:41:40.560225 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.560200    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/662869a0-e212-493d-940a-913af15e7cc6-webhook-cert\") pod \"maas-controller-d55c76586-4xd57\" (UID: \"662869a0-e212-493d-940a-913af15e7cc6\") " pod="opendatahub/maas-controller-d55c76586-4xd57"
Jul 27 17:41:40.566318 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.566296    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8srjm\" (UniqueName: \"kubernetes.io/projected/662869a0-e212-493d-940a-913af15e7cc6-kube-api-access-8srjm\") pod \"maas-controller-d55c76586-4xd57\" (UID: \"662869a0-e212-493d-940a-913af15e7cc6\") " pod="opendatahub/maas-controller-d55c76586-4xd57"
Jul 27 17:41:40.650460 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.650361    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d55c76586-4xd57"
Jul 27 17:41:40.789036 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.789010    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d55c76586-4xd57"]
Jul 27 17:41:40.791438 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:41:40.791412    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662869a0_e212_493d_940a_913af15e7cc6.slice/crio-3190e2894ce0b124a5e539f73be4026766b3f8581bc44fac837493943fa21bf5 WatchSource:0}: Error finding container 3190e2894ce0b124a5e539f73be4026766b3f8581bc44fac837493943fa21bf5: Status 404 returned error can't find the container with id 3190e2894ce0b124a5e539f73be4026766b3f8581bc44fac837493943fa21bf5
Jul 27 17:41:40.792717 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.792699    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:41:40.805512 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:40.805480    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d55c76586-4xd57" event={"ID":"662869a0-e212-493d-940a-913af15e7cc6","Type":"ContainerStarted","Data":"3190e2894ce0b124a5e539f73be4026766b3f8581bc44fac837493943fa21bf5"}
Jul 27 17:41:41.811615 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:41.811563    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d55c76586-4xd57" event={"ID":"662869a0-e212-493d-940a-913af15e7cc6","Type":"ContainerStarted","Data":"94d7e97ec1ed0392684c79987b7c06e888f8c897203c71728679a9534d66fbe5"}
Jul 27 17:41:41.812032 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:41.811649    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d55c76586-4xd57"
Jul 27 17:41:41.830959 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:41.830912    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d55c76586-4xd57" podStartSLOduration=1.4240432250000001 podStartE2EDuration="1.830897012s" totalImagesPullingTime="406.853787ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:41:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:41:41.829529745 +0000 UTC m=+1044.844196189" watchObservedRunningTime="2026-07-27 17:41:41.830897012 +0000 UTC m=+1044.845563457"
Jul 27 17:41:52.819103 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:52.819065    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d55c76586-4xd57"
Jul 27 17:41:57.466633 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.466597    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d55c76586-4xd57"]
Jul 27 17:41:57.467097 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.466839    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-d55c76586-4xd57" podUID="662869a0-e212-493d-940a-913af15e7cc6" containerName="manager" containerID="cri-o://94d7e97ec1ed0392684c79987b7c06e888f8c897203c71728679a9534d66fbe5" gracePeriod=30
Jul 27 17:41:57.717967 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.717895    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d55c76586-4xd57"
Jul 27 17:41:57.817906 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.817871    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/662869a0-e212-493d-940a-913af15e7cc6-webhook-cert\") pod \"662869a0-e212-493d-940a-913af15e7cc6\" (UID: \"662869a0-e212-493d-940a-913af15e7cc6\") "
Jul 27 17:41:57.818088 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.817930    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8srjm\" (UniqueName: \"kubernetes.io/projected/662869a0-e212-493d-940a-913af15e7cc6-kube-api-access-8srjm\") pod \"662869a0-e212-493d-940a-913af15e7cc6\" (UID: \"662869a0-e212-493d-940a-913af15e7cc6\") "
Jul 27 17:41:57.819976 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.819945    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/662869a0-e212-493d-940a-913af15e7cc6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "662869a0-e212-493d-940a-913af15e7cc6" (UID: "662869a0-e212-493d-940a-913af15e7cc6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:41:57.819976 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.819961    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/662869a0-e212-493d-940a-913af15e7cc6-kube-api-access-8srjm" (OuterVolumeSpecName: "kube-api-access-8srjm") pod "662869a0-e212-493d-940a-913af15e7cc6" (UID: "662869a0-e212-493d-940a-913af15e7cc6"). InnerVolumeSpecName "kube-api-access-8srjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:41:57.888289 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.888252    2580 generic.go:356] "Generic (PLEG): container finished" podID="662869a0-e212-493d-940a-913af15e7cc6" containerID="94d7e97ec1ed0392684c79987b7c06e888f8c897203c71728679a9534d66fbe5" exitCode=0
Jul 27 17:41:57.888441 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.888303    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d55c76586-4xd57"
Jul 27 17:41:57.888441 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.888335    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d55c76586-4xd57" event={"ID":"662869a0-e212-493d-940a-913af15e7cc6","Type":"ContainerDied","Data":"94d7e97ec1ed0392684c79987b7c06e888f8c897203c71728679a9534d66fbe5"}
Jul 27 17:41:57.888441 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.888393    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d55c76586-4xd57" event={"ID":"662869a0-e212-493d-940a-913af15e7cc6","Type":"ContainerDied","Data":"3190e2894ce0b124a5e539f73be4026766b3f8581bc44fac837493943fa21bf5"}
Jul 27 17:41:57.888441 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.888415    2580 scope.go:117] "RemoveContainer" containerID="94d7e97ec1ed0392684c79987b7c06e888f8c897203c71728679a9534d66fbe5"
Jul 27 17:41:57.897221 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.897202    2580 scope.go:117] "RemoveContainer" containerID="94d7e97ec1ed0392684c79987b7c06e888f8c897203c71728679a9534d66fbe5"
Jul 27 17:41:57.897461 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:41:57.897443    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94d7e97ec1ed0392684c79987b7c06e888f8c897203c71728679a9534d66fbe5\": container with ID starting with 94d7e97ec1ed0392684c79987b7c06e888f8c897203c71728679a9534d66fbe5 not found: ID does not exist" containerID="94d7e97ec1ed0392684c79987b7c06e888f8c897203c71728679a9534d66fbe5"
Jul 27 17:41:57.897518 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.897470    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94d7e97ec1ed0392684c79987b7c06e888f8c897203c71728679a9534d66fbe5"} err="failed to get container status \"94d7e97ec1ed0392684c79987b7c06e888f8c897203c71728679a9534d66fbe5\": rpc error: code = NotFound desc = could not find container \"94d7e97ec1ed0392684c79987b7c06e888f8c897203c71728679a9534d66fbe5\": container with ID starting with 94d7e97ec1ed0392684c79987b7c06e888f8c897203c71728679a9534d66fbe5 not found: ID does not exist"
Jul 27 17:41:57.913373 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.913351    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d55c76586-4xd57"]
Jul 27 17:41:57.917101 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.917073    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d55c76586-4xd57"]
Jul 27 17:41:57.918788 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.918772    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/662869a0-e212-493d-940a-913af15e7cc6-webhook-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:41:57.918854 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:57.918792    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8srjm\" (UniqueName: \"kubernetes.io/projected/662869a0-e212-493d-940a-913af15e7cc6-kube-api-access-8srjm\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:41:58.699413 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:58.699369    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d55c76586-n82wl"]
Jul 27 17:41:58.700005 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:58.699936    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="662869a0-e212-493d-940a-913af15e7cc6" containerName="manager"
Jul 27 17:41:58.700005 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:58.699956    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="662869a0-e212-493d-940a-913af15e7cc6" containerName="manager"
Jul 27 17:41:58.700126 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:58.700040    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="662869a0-e212-493d-940a-913af15e7cc6" containerName="manager"
Jul 27 17:41:58.703148 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:58.703126    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d55c76586-n82wl"
Jul 27 17:41:58.706741 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:58.706719    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z8v8w\""
Jul 27 17:41:58.706859 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:58.706718    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 17:41:58.706859 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:58.706728    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 17:41:58.710543 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:58.710505    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d55c76586-n82wl"]
Jul 27 17:41:58.727066 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:58.727039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b23b1d81-b398-406b-982d-7ec8c40ebad6-webhook-cert\") pod \"maas-controller-d55c76586-n82wl\" (UID: \"b23b1d81-b398-406b-982d-7ec8c40ebad6\") " pod="opendatahub/maas-controller-d55c76586-n82wl"
Jul 27 17:41:58.727176 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:58.727074    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tsmt\" (UniqueName: \"kubernetes.io/projected/b23b1d81-b398-406b-982d-7ec8c40ebad6-kube-api-access-2tsmt\") pod \"maas-controller-d55c76586-n82wl\" (UID: \"b23b1d81-b398-406b-982d-7ec8c40ebad6\") " pod="opendatahub/maas-controller-d55c76586-n82wl"
Jul 27 17:41:58.827635 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:58.827597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b23b1d81-b398-406b-982d-7ec8c40ebad6-webhook-cert\") pod \"maas-controller-d55c76586-n82wl\" (UID: \"b23b1d81-b398-406b-982d-7ec8c40ebad6\") " pod="opendatahub/maas-controller-d55c76586-n82wl"
Jul 27 17:41:58.827635 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:58.827642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tsmt\" (UniqueName: \"kubernetes.io/projected/b23b1d81-b398-406b-982d-7ec8c40ebad6-kube-api-access-2tsmt\") pod \"maas-controller-d55c76586-n82wl\" (UID: \"b23b1d81-b398-406b-982d-7ec8c40ebad6\") " pod="opendatahub/maas-controller-d55c76586-n82wl"
Jul 27 17:41:58.830239 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:58.830201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b23b1d81-b398-406b-982d-7ec8c40ebad6-webhook-cert\") pod \"maas-controller-d55c76586-n82wl\" (UID: \"b23b1d81-b398-406b-982d-7ec8c40ebad6\") " pod="opendatahub/maas-controller-d55c76586-n82wl"
Jul 27 17:41:58.837127 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:58.837102    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tsmt\" (UniqueName: \"kubernetes.io/projected/b23b1d81-b398-406b-982d-7ec8c40ebad6-kube-api-access-2tsmt\") pod \"maas-controller-d55c76586-n82wl\" (UID: \"b23b1d81-b398-406b-982d-7ec8c40ebad6\") " pod="opendatahub/maas-controller-d55c76586-n82wl"
Jul 27 17:41:59.014039 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:59.013953    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d55c76586-n82wl"
Jul 27 17:41:59.155725 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:59.155647    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d55c76586-n82wl"]
Jul 27 17:41:59.158095 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:41:59.158068    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb23b1d81_b398_406b_982d_7ec8c40ebad6.slice/crio-fd1b34f3c72e98f74c39bcb1c5a87076382248deb5d60dd2cca800ec53190ae8 WatchSource:0}: Error finding container fd1b34f3c72e98f74c39bcb1c5a87076382248deb5d60dd2cca800ec53190ae8: Status 404 returned error can't find the container with id fd1b34f3c72e98f74c39bcb1c5a87076382248deb5d60dd2cca800ec53190ae8
Jul 27 17:41:59.476571 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:59.476537    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="662869a0-e212-493d-940a-913af15e7cc6" path="/var/lib/kubelet/pods/662869a0-e212-493d-940a-913af15e7cc6/volumes"
Jul 27 17:41:59.901079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:59.900989    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d55c76586-n82wl" event={"ID":"b23b1d81-b398-406b-982d-7ec8c40ebad6","Type":"ContainerStarted","Data":"bd15678e35c98a21a758bc90b081e8e3d231ea75c362773dd8f45a6787a548d3"}
Jul 27 17:41:59.901443 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:59.901084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d55c76586-n82wl" event={"ID":"b23b1d81-b398-406b-982d-7ec8c40ebad6","Type":"ContainerStarted","Data":"fd1b34f3c72e98f74c39bcb1c5a87076382248deb5d60dd2cca800ec53190ae8"}
Jul 27 17:41:59.901443 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:59.901113    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d55c76586-n82wl"
Jul 27 17:41:59.917840 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:41:59.917786    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d55c76586-n82wl" podStartSLOduration=1.506887979 podStartE2EDuration="1.917768275s" totalImagesPullingTime="410.880296ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:41:59.917019661 +0000 UTC m=+1062.931686105" watchObservedRunningTime="2026-07-27 17:41:59.917768275 +0000 UTC m=+1062.932434719"
Jul 27 17:42:10.908463 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:42:10.908375    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d55c76586-n82wl"
Jul 27 17:50:31.186877 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.186843    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"]
Jul 27 17:50:31.190174 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.190156    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.192682 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.192661    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-370bd585-kserve-self-signed-certs\""
Jul 27 17:50:31.205765 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.205743    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"]
Jul 27 17:50:31.243827 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.243803    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/349d8af0-8696-46d4-8416-4ff6069dfde1-tls-certs\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.243933 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.243860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smr5n\" (UniqueName: \"kubernetes.io/projected/349d8af0-8696-46d4-8416-4ff6069dfde1-kube-api-access-smr5n\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.243933 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.243916    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-tmp-dir\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.244007 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.243932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-dshm\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.244007 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.243953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-model-cache\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.244007 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.243974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-home\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.345091 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.345059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-home\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.345260 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.345107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/349d8af0-8696-46d4-8416-4ff6069dfde1-tls-certs\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.345260 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.345160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smr5n\" (UniqueName: \"kubernetes.io/projected/349d8af0-8696-46d4-8416-4ff6069dfde1-kube-api-access-smr5n\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.345260 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.345190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-tmp-dir\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.345260 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.345215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-dshm\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.345260 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.345241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-model-cache\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.345550 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.345523    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-home\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.345645 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.345552    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-tmp-dir\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.345708 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.345684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-model-cache\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.347562 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.347538    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-dshm\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.347762 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.347744    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/349d8af0-8696-46d4-8416-4ff6069dfde1-tls-certs\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.353247 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.353225    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smr5n\" (UniqueName: \"kubernetes.io/projected/349d8af0-8696-46d4-8416-4ff6069dfde1-kube-api-access-smr5n\") pod \"e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") " pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.500738 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.500659    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:31.632101 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:31.632073    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"]
Jul 27 17:50:31.634419 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:50:31.634390    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod349d8af0_8696_46d4_8416_4ff6069dfde1.slice/crio-1e37b9f91aa69dc931b7cc63fc3bb6892ec2fc68ba3c57839c8af2f2d9337550 WatchSource:0}: Error finding container 1e37b9f91aa69dc931b7cc63fc3bb6892ec2fc68ba3c57839c8af2f2d9337550: Status 404 returned error can't find the container with id 1e37b9f91aa69dc931b7cc63fc3bb6892ec2fc68ba3c57839c8af2f2d9337550
Jul 27 17:50:32.333915 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:32.333868    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp" event={"ID":"349d8af0-8696-46d4-8416-4ff6069dfde1","Type":"ContainerStarted","Data":"d71c1e70f00da7e07109ea0fe3f8ad92cb91832a51291e6ded351e339559591f"}
Jul 27 17:50:32.334331 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:32.333924    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp" event={"ID":"349d8af0-8696-46d4-8416-4ff6069dfde1","Type":"ContainerStarted","Data":"1e37b9f91aa69dc931b7cc63fc3bb6892ec2fc68ba3c57839c8af2f2d9337550"}
Jul 27 17:50:32.351756 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:32.351704    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp" podStartSLOduration=1.351688612 podStartE2EDuration="1.351688612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:50:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:50:32.350728382 +0000 UTC m=+1575.365394826" watchObservedRunningTime="2026-07-27 17:50:32.351688612 +0000 UTC m=+1575.366355113"
Jul 27 17:50:41.501138 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:41.501044    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:41.501138 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:41.501089    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:41.513334 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:41.513312    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:42.391388 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:42.391354    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:50:44.001300 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.001264    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"]
Jul 27 17:50:44.004736 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.004719    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.007425 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.007405    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-370bd585-kserve-self-signed-certs\""
Jul 27 17:50:44.015997 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.015980    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"]
Jul 27 17:50:44.049940 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.049917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-dshm\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.050041 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.049950    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-tls-certs\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.050041 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.049974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-model-cache\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.050041 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.050029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-home\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.050154 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.050089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-244kk\" (UniqueName: \"kubernetes.io/projected/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-kube-api-access-244kk\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.050154 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.050126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-tmp-dir\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.151016 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.150986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-244kk\" (UniqueName: \"kubernetes.io/projected/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-kube-api-access-244kk\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.151206 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.151030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-tmp-dir\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.151206 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.151159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-dshm\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.151206 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.151182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-tls-certs\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.151206 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.151205    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-model-cache\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.151695 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.151238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-home\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.151695 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.151456    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-tmp-dir\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.151695 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.151572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-home\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.151695 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.151635    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-model-cache\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.153157 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.153134    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-dshm\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.153416 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.153400    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-tls-certs\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.158774 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.158752    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-244kk\" (UniqueName: \"kubernetes.io/projected/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-kube-api-access-244kk\") pod \"e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") " pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.315538 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.315455    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:44.451573 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:44.451534    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"]
Jul 27 17:50:45.397109 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:45.397066    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h" event={"ID":"e39f7e91-baf3-419f-8f0b-aa5aabec8b00","Type":"ContainerStarted","Data":"0659102142dd820a9f70c1999585a6543b7cc9aa0311fc45b954ada20dc7cfc6"}
Jul 27 17:50:45.397109 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:45.397112    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h" event={"ID":"e39f7e91-baf3-419f-8f0b-aa5aabec8b00","Type":"ContainerStarted","Data":"9d8b7cee098493debc1255757752e010c94a217a54ae0a56f600762be7b7fbd0"}
Jul 27 17:50:45.418337 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:45.418289    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h" podStartSLOduration=2.418273651 podStartE2EDuration="2.418273651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:50:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:50:45.415892669 +0000 UTC m=+1588.430559114" watchObservedRunningTime="2026-07-27 17:50:45.418273651 +0000 UTC m=+1588.432940153"
Jul 27 17:50:54.316508 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:54.316475    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:54.317062 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:54.316526    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:54.328978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:54.328953    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:50:54.455135 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:50:54.455106    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:51:06.759450 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:06.759411    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"]
Jul 27 17:51:08.371532 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:08.371499    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"]
Jul 27 17:51:21.778913 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:21.778862    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp" podUID="349d8af0-8696-46d4-8416-4ff6069dfde1" containerName="main" containerID="cri-o://d71c1e70f00da7e07109ea0fe3f8ad92cb91832a51291e6ded351e339559591f" gracePeriod=45
Jul 27 17:51:22.028616 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.028573    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:51:22.089676 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.089553    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-home\") pod \"349d8af0-8696-46d4-8416-4ff6069dfde1\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") "
Jul 27 17:51:22.089837 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.089809    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-tmp-dir\") pod \"349d8af0-8696-46d4-8416-4ff6069dfde1\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") "
Jul 27 17:51:22.089916 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.089896    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smr5n\" (UniqueName: \"kubernetes.io/projected/349d8af0-8696-46d4-8416-4ff6069dfde1-kube-api-access-smr5n\") pod \"349d8af0-8696-46d4-8416-4ff6069dfde1\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") "
Jul 27 17:51:22.089968 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.089906    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-home" (OuterVolumeSpecName: "home") pod "349d8af0-8696-46d4-8416-4ff6069dfde1" (UID: "349d8af0-8696-46d4-8416-4ff6069dfde1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:51:22.090088 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.089935    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/349d8af0-8696-46d4-8416-4ff6069dfde1-tls-certs\") pod \"349d8af0-8696-46d4-8416-4ff6069dfde1\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") "
Jul 27 17:51:22.090162 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.090118    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-model-cache\") pod \"349d8af0-8696-46d4-8416-4ff6069dfde1\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") "
Jul 27 17:51:22.090281 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.090166    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-dshm\") pod \"349d8af0-8696-46d4-8416-4ff6069dfde1\" (UID: \"349d8af0-8696-46d4-8416-4ff6069dfde1\") "
Jul 27 17:51:22.090361 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.090323    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "349d8af0-8696-46d4-8416-4ff6069dfde1" (UID: "349d8af0-8696-46d4-8416-4ff6069dfde1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:51:22.090597 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.090539    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-home\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:51:22.090702 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.090608    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-tmp-dir\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:51:22.090702 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.090658    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-model-cache" (OuterVolumeSpecName: "model-cache") pod "349d8af0-8696-46d4-8416-4ff6069dfde1" (UID: "349d8af0-8696-46d4-8416-4ff6069dfde1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:51:22.092279 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.092257    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-dshm" (OuterVolumeSpecName: "dshm") pod "349d8af0-8696-46d4-8416-4ff6069dfde1" (UID: "349d8af0-8696-46d4-8416-4ff6069dfde1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:51:22.092444 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.092422    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/349d8af0-8696-46d4-8416-4ff6069dfde1-kube-api-access-smr5n" (OuterVolumeSpecName: "kube-api-access-smr5n") pod "349d8af0-8696-46d4-8416-4ff6069dfde1" (UID: "349d8af0-8696-46d4-8416-4ff6069dfde1"). InnerVolumeSpecName "kube-api-access-smr5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:51:22.092510 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.092466    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/349d8af0-8696-46d4-8416-4ff6069dfde1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "349d8af0-8696-46d4-8416-4ff6069dfde1" (UID: "349d8af0-8696-46d4-8416-4ff6069dfde1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:51:22.191450 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.191417    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smr5n\" (UniqueName: \"kubernetes.io/projected/349d8af0-8696-46d4-8416-4ff6069dfde1-kube-api-access-smr5n\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:51:22.191450 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.191450    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/349d8af0-8696-46d4-8416-4ff6069dfde1-tls-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:51:22.191678 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.191465    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-model-cache\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:51:22.191678 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.191474    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/349d8af0-8696-46d4-8416-4ff6069dfde1-dshm\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:51:22.574837 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.574798    2580 generic.go:356] "Generic (PLEG): container finished" podID="349d8af0-8696-46d4-8416-4ff6069dfde1" containerID="d71c1e70f00da7e07109ea0fe3f8ad92cb91832a51291e6ded351e339559591f" exitCode=0
Jul 27 17:51:22.575041 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.574862    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"
Jul 27 17:51:22.575041 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.574886    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp" event={"ID":"349d8af0-8696-46d4-8416-4ff6069dfde1","Type":"ContainerDied","Data":"d71c1e70f00da7e07109ea0fe3f8ad92cb91832a51291e6ded351e339559591f"}
Jul 27 17:51:22.575041 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.574944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp" event={"ID":"349d8af0-8696-46d4-8416-4ff6069dfde1","Type":"ContainerDied","Data":"1e37b9f91aa69dc931b7cc63fc3bb6892ec2fc68ba3c57839c8af2f2d9337550"}
Jul 27 17:51:22.575041 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.574969    2580 scope.go:117] "RemoveContainer" containerID="d71c1e70f00da7e07109ea0fe3f8ad92cb91832a51291e6ded351e339559591f"
Jul 27 17:51:22.584196 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.584178    2580 scope.go:117] "RemoveContainer" containerID="d71c1e70f00da7e07109ea0fe3f8ad92cb91832a51291e6ded351e339559591f"
Jul 27 17:51:22.584446 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:51:22.584425    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d71c1e70f00da7e07109ea0fe3f8ad92cb91832a51291e6ded351e339559591f\": container with ID starting with d71c1e70f00da7e07109ea0fe3f8ad92cb91832a51291e6ded351e339559591f not found: ID does not exist" containerID="d71c1e70f00da7e07109ea0fe3f8ad92cb91832a51291e6ded351e339559591f"
Jul 27 17:51:22.584523 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.584457    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d71c1e70f00da7e07109ea0fe3f8ad92cb91832a51291e6ded351e339559591f"} err="failed to get container status \"d71c1e70f00da7e07109ea0fe3f8ad92cb91832a51291e6ded351e339559591f\": rpc error: code = NotFound desc = could not find container \"d71c1e70f00da7e07109ea0fe3f8ad92cb91832a51291e6ded351e339559591f\": container with ID starting with d71c1e70f00da7e07109ea0fe3f8ad92cb91832a51291e6ded351e339559591f not found: ID does not exist"
Jul 27 17:51:22.596198 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.596175    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"]
Jul 27 17:51:22.601527 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:22.601506    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-370bd585-kserve-65f9f68c95-sp7pp"]
Jul 27 17:51:23.392828 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.392764    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h" podUID="e39f7e91-baf3-419f-8f0b-aa5aabec8b00" containerName="main" containerID="cri-o://0659102142dd820a9f70c1999585a6543b7cc9aa0311fc45b954ada20dc7cfc6" gracePeriod=45
Jul 27 17:51:23.476282 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.476249    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="349d8af0-8696-46d4-8416-4ff6069dfde1" path="/var/lib/kubelet/pods/349d8af0-8696-46d4-8416-4ff6069dfde1/volumes"
Jul 27 17:51:23.582161 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.582132    2580 generic.go:356] "Generic (PLEG): container finished" podID="e39f7e91-baf3-419f-8f0b-aa5aabec8b00" containerID="0659102142dd820a9f70c1999585a6543b7cc9aa0311fc45b954ada20dc7cfc6" exitCode=0
Jul 27 17:51:23.582319 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.582207    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h" event={"ID":"e39f7e91-baf3-419f-8f0b-aa5aabec8b00","Type":"ContainerDied","Data":"0659102142dd820a9f70c1999585a6543b7cc9aa0311fc45b954ada20dc7cfc6"}
Jul 27 17:51:23.643000 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.642939    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:51:23.706285 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.706246    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-tls-certs\") pod \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") "
Jul 27 17:51:23.706467 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.706304    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-244kk\" (UniqueName: \"kubernetes.io/projected/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-kube-api-access-244kk\") pod \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") "
Jul 27 17:51:23.706467 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.706333    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-tmp-dir\") pod \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") "
Jul 27 17:51:23.706467 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.706375    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-dshm\") pod \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") "
Jul 27 17:51:23.706467 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.706400    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-model-cache\") pod \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") "
Jul 27 17:51:23.706467 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.706445    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-home\") pod \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\" (UID: \"e39f7e91-baf3-419f-8f0b-aa5aabec8b00\") "
Jul 27 17:51:23.706772 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.706668    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e39f7e91-baf3-419f-8f0b-aa5aabec8b00" (UID: "e39f7e91-baf3-419f-8f0b-aa5aabec8b00"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:51:23.706834 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.706804    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-tmp-dir\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:51:23.707019 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.706814    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-model-cache" (OuterVolumeSpecName: "model-cache") pod "e39f7e91-baf3-419f-8f0b-aa5aabec8b00" (UID: "e39f7e91-baf3-419f-8f0b-aa5aabec8b00"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:51:23.707209 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.706880    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-home" (OuterVolumeSpecName: "home") pod "e39f7e91-baf3-419f-8f0b-aa5aabec8b00" (UID: "e39f7e91-baf3-419f-8f0b-aa5aabec8b00"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:51:23.708570 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.708542    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-kube-api-access-244kk" (OuterVolumeSpecName: "kube-api-access-244kk") pod "e39f7e91-baf3-419f-8f0b-aa5aabec8b00" (UID: "e39f7e91-baf3-419f-8f0b-aa5aabec8b00"). InnerVolumeSpecName "kube-api-access-244kk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:51:23.708570 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.708565    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e39f7e91-baf3-419f-8f0b-aa5aabec8b00" (UID: "e39f7e91-baf3-419f-8f0b-aa5aabec8b00"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:51:23.708955 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.708935    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-dshm" (OuterVolumeSpecName: "dshm") pod "e39f7e91-baf3-419f-8f0b-aa5aabec8b00" (UID: "e39f7e91-baf3-419f-8f0b-aa5aabec8b00"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:51:23.807524 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.807494    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-tls-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:51:23.807524 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.807520    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-244kk\" (UniqueName: \"kubernetes.io/projected/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-kube-api-access-244kk\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:51:23.807524 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.807531    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-dshm\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:51:23.807785 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.807541    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-model-cache\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:51:23.807785 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:23.807550    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e39f7e91-baf3-419f-8f0b-aa5aabec8b00-home\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:51:24.589415 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:24.589375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h" event={"ID":"e39f7e91-baf3-419f-8f0b-aa5aabec8b00","Type":"ContainerDied","Data":"9d8b7cee098493debc1255757752e010c94a217a54ae0a56f600762be7b7fbd0"}
Jul 27 17:51:24.589891 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:24.589430    2580 scope.go:117] "RemoveContainer" containerID="0659102142dd820a9f70c1999585a6543b7cc9aa0311fc45b954ada20dc7cfc6"
Jul 27 17:51:24.589891 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:24.589400    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"
Jul 27 17:51:24.611469 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:24.611443    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"]
Jul 27 17:51:24.615459 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:24.615437    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-370bd585-kserve-c7dc85987-qhk4h"]
Jul 27 17:51:25.476285 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:51:25.476246    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e39f7e91-baf3-419f-8f0b-aa5aabec8b00" path="/var/lib/kubelet/pods/e39f7e91-baf3-419f-8f0b-aa5aabec8b00/volumes"
Jul 27 17:54:40.625904 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.625868    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"]
Jul 27 17:54:40.626320 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.626260    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="349d8af0-8696-46d4-8416-4ff6069dfde1" containerName="main"
Jul 27 17:54:40.626320 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.626273    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="349d8af0-8696-46d4-8416-4ff6069dfde1" containerName="main"
Jul 27 17:54:40.626320 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.626290    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e39f7e91-baf3-419f-8f0b-aa5aabec8b00" containerName="main"
Jul 27 17:54:40.626320 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.626296    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e39f7e91-baf3-419f-8f0b-aa5aabec8b00" containerName="main"
Jul 27 17:54:40.626455 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.626352    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e39f7e91-baf3-419f-8f0b-aa5aabec8b00" containerName="main"
Jul 27 17:54:40.626455 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.626368    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="349d8af0-8696-46d4-8416-4ff6069dfde1" containerName="main"
Jul 27 17:54:40.628840 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.628824    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.631474 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.631454    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0bc6c8fc-openshift-default-dockercfg-6hs4c\""
Jul 27 17:54:40.647680 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.647655    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"]
Jul 27 17:54:40.710829 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.710748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-workload-certs\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.710829 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.710832    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-envoy\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.711066 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.710862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw9zf\" (UniqueName: \"kubernetes.io/projected/a604a286-7dc4-4a49-add9-bac393ea26f4-kube-api-access-qw9zf\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.711066 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.710892    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a604a286-7dc4-4a49-add9-bac393ea26f4-istiod-ca-cert\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.711066 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.711010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-workload-socket\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.711066 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.711058    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-credential-socket\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.711228 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.711086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-token\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.711228 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.711123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-podinfo\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.711228 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.711160    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-data\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.811843 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.811808    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-workload-certs\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.812033 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.811861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-envoy\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.812033 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.811991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw9zf\" (UniqueName: \"kubernetes.io/projected/a604a286-7dc4-4a49-add9-bac393ea26f4-kube-api-access-qw9zf\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.812164 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.812049    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a604a286-7dc4-4a49-add9-bac393ea26f4-istiod-ca-cert\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.812164 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.812136    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-workload-socket\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.812268 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.812165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-credential-socket\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.812268 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.812175    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-workload-certs\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.812268 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.812192    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-token\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.812268 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.812249    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-podinfo\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.812463 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.812285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-data\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.812554 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.812530    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-credential-socket\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.812640 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.812574    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-data\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.812759 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.812733    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-workload-socket\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.812759 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.812754    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a604a286-7dc4-4a49-add9-bac393ea26f4-istiod-ca-cert\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.814141 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.814122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-envoy\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.814609 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.814565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-podinfo\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.820003 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.819981    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-token\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.820164 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.820145    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw9zf\" (UniqueName: \"kubernetes.io/projected/a604a286-7dc4-4a49-add9-bac393ea26f4-kube-api-access-qw9zf\") pod \"e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") " pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:40.939566 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:40.939532    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:41.081702 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:41.081676    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"]
Jul 27 17:54:41.083995 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:54:41.083957    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda604a286_7dc4_4a49_add9_bac393ea26f4.slice/crio-f4d6ac23776ed70135269a2af18222ebe598265df371b71eeda86676570b9ec9 WatchSource:0}: Error finding container f4d6ac23776ed70135269a2af18222ebe598265df371b71eeda86676570b9ec9: Status 404 returned error can't find the container with id f4d6ac23776ed70135269a2af18222ebe598265df371b71eeda86676570b9ec9
Jul 27 17:54:41.086107 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:41.086070    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:54:41.086199 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:41.086138    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:54:41.086199 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:41.086169    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:54:41.542861 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:41.542822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2" event={"ID":"a604a286-7dc4-4a49-add9-bac393ea26f4","Type":"ContainerStarted","Data":"b40aa6ead730d6d1ad9d50c050273a440f973f7271a4b6eb7e33f119929b334f"}
Jul 27 17:54:41.543219 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:41.542882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2" event={"ID":"a604a286-7dc4-4a49-add9-bac393ea26f4","Type":"ContainerStarted","Data":"f4d6ac23776ed70135269a2af18222ebe598265df371b71eeda86676570b9ec9"}
Jul 27 17:54:41.562839 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:41.562787    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2" podStartSLOduration=1.562772528 podStartE2EDuration="1.562772528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:54:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:54:41.5617858 +0000 UTC m=+1824.576452245" watchObservedRunningTime="2026-07-27 17:54:41.562772528 +0000 UTC m=+1824.577438972"
Jul 27 17:54:41.939981 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:41.939943    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:42.945805 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:42.945771    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:43.105109 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.105076    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"]
Jul 27 17:54:43.108868 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.108848    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"
Jul 27 17:54:43.111563 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.111542    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0bc6c8fc-serving-cert\""
Jul 27 17:54:43.118029 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.118009    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"]
Jul 27 17:54:43.136773 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.136748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa94a4c2-540d-43f7-9d27-861d5eea696a-openshift-service-ca\") pod \"maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884\" (UID: \"fa94a4c2-540d-43f7-9d27-861d5eea696a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"
Jul 27 17:54:43.136882 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.136784    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkww8\" (UniqueName: \"kubernetes.io/projected/fa94a4c2-540d-43f7-9d27-861d5eea696a-kube-api-access-rkww8\") pod \"maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884\" (UID: \"fa94a4c2-540d-43f7-9d27-861d5eea696a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"
Jul 27 17:54:43.136882 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.136862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa94a4c2-540d-43f7-9d27-861d5eea696a-maas-api-tls\") pod \"maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884\" (UID: \"fa94a4c2-540d-43f7-9d27-861d5eea696a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"
Jul 27 17:54:43.238107 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.238010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa94a4c2-540d-43f7-9d27-861d5eea696a-maas-api-tls\") pod \"maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884\" (UID: \"fa94a4c2-540d-43f7-9d27-861d5eea696a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"
Jul 27 17:54:43.238107 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.238083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa94a4c2-540d-43f7-9d27-861d5eea696a-openshift-service-ca\") pod \"maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884\" (UID: \"fa94a4c2-540d-43f7-9d27-861d5eea696a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"
Jul 27 17:54:43.238354 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:54:43.238168    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-serving-cert: secret "maas-api-e2e-ait-0bc6c8fc-serving-cert" not found
Jul 27 17:54:43.238354 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.238181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkww8\" (UniqueName: \"kubernetes.io/projected/fa94a4c2-540d-43f7-9d27-861d5eea696a-kube-api-access-rkww8\") pod \"maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884\" (UID: \"fa94a4c2-540d-43f7-9d27-861d5eea696a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"
Jul 27 17:54:43.238354 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:54:43.238238    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa94a4c2-540d-43f7-9d27-861d5eea696a-maas-api-tls podName:fa94a4c2-540d-43f7-9d27-861d5eea696a nodeName:}" failed. No retries permitted until 2026-07-27 17:54:43.738217596 +0000 UTC m=+1826.752884033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fa94a4c2-540d-43f7-9d27-861d5eea696a-maas-api-tls") pod "maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884" (UID: "fa94a4c2-540d-43f7-9d27-861d5eea696a") : secret "maas-api-e2e-ait-0bc6c8fc-serving-cert" not found
Jul 27 17:54:43.238764 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.238747    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa94a4c2-540d-43f7-9d27-861d5eea696a-openshift-service-ca\") pod \"maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884\" (UID: \"fa94a4c2-540d-43f7-9d27-861d5eea696a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"
Jul 27 17:54:43.249846 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.249824    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkww8\" (UniqueName: \"kubernetes.io/projected/fa94a4c2-540d-43f7-9d27-861d5eea696a-kube-api-access-rkww8\") pod \"maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884\" (UID: \"fa94a4c2-540d-43f7-9d27-861d5eea696a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"
Jul 27 17:54:43.553903 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.553824    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:43.554811 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.554786    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:43.743049 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.743015    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"]
Jul 27 17:54:43.744352 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.744319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa94a4c2-540d-43f7-9d27-861d5eea696a-maas-api-tls\") pod \"maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884\" (UID: \"fa94a4c2-540d-43f7-9d27-861d5eea696a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"
Jul 27 17:54:43.746637 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.746616    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"
Jul 27 17:54:43.747135 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.747113    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa94a4c2-540d-43f7-9d27-861d5eea696a-maas-api-tls\") pod \"maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884\" (UID: \"fa94a4c2-540d-43f7-9d27-861d5eea696a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"
Jul 27 17:54:43.750731 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.750710    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-0bc6c8fc\""
Jul 27 17:54:43.766364 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.766339    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"]
Jul 27 17:54:43.791813 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.791784    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"]
Jul 27 17:54:43.795348 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.795331    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"
Jul 27 17:54:43.799524 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.799504    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-0bc6c8fc-dockercfg-hwlfq\""
Jul 27 17:54:43.809111 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.809064    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"]
Jul 27 17:54:43.844916 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.844885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd30a223-16ec-4993-a722-ff44e7733596-plugins-config-volume\") pod \"payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq\" (UID: \"fd30a223-16ec-4993-a722-ff44e7733596\") " pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"
Jul 27 17:54:43.845067 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.844928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmqfv\" (UniqueName: \"kubernetes.io/projected/78b620f1-d4ac-44cb-9932-f91fec0a5e9f-kube-api-access-gmqfv\") pod \"payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr\" (UID: \"78b620f1-d4ac-44cb-9932-f91fec0a5e9f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"
Jul 27 17:54:43.845067 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.844950    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78b620f1-d4ac-44cb-9932-f91fec0a5e9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr\" (UID: \"78b620f1-d4ac-44cb-9932-f91fec0a5e9f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"
Jul 27 17:54:43.845067 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.845019    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb9vv\" (UniqueName: \"kubernetes.io/projected/fd30a223-16ec-4993-a722-ff44e7733596-kube-api-access-wb9vv\") pod \"payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq\" (UID: \"fd30a223-16ec-4993-a722-ff44e7733596\") " pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"
Jul 27 17:54:43.946337 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.946302    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd30a223-16ec-4993-a722-ff44e7733596-plugins-config-volume\") pod \"payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq\" (UID: \"fd30a223-16ec-4993-a722-ff44e7733596\") " pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"
Jul 27 17:54:43.946337 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.946337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmqfv\" (UniqueName: \"kubernetes.io/projected/78b620f1-d4ac-44cb-9932-f91fec0a5e9f-kube-api-access-gmqfv\") pod \"payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr\" (UID: \"78b620f1-d4ac-44cb-9932-f91fec0a5e9f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"
Jul 27 17:54:43.946843 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.946357    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78b620f1-d4ac-44cb-9932-f91fec0a5e9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr\" (UID: \"78b620f1-d4ac-44cb-9932-f91fec0a5e9f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"
Jul 27 17:54:43.946843 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.946388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb9vv\" (UniqueName: \"kubernetes.io/projected/fd30a223-16ec-4993-a722-ff44e7733596-kube-api-access-wb9vv\") pod \"payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq\" (UID: \"fd30a223-16ec-4993-a722-ff44e7733596\") " pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"
Jul 27 17:54:43.947342 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.947317    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd30a223-16ec-4993-a722-ff44e7733596-plugins-config-volume\") pod \"payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq\" (UID: \"fd30a223-16ec-4993-a722-ff44e7733596\") " pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"
Jul 27 17:54:43.947381 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.947317    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78b620f1-d4ac-44cb-9932-f91fec0a5e9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr\" (UID: \"78b620f1-d4ac-44cb-9932-f91fec0a5e9f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"
Jul 27 17:54:43.956030 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.956003    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb9vv\" (UniqueName: \"kubernetes.io/projected/fd30a223-16ec-4993-a722-ff44e7733596-kube-api-access-wb9vv\") pod \"payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq\" (UID: \"fd30a223-16ec-4993-a722-ff44e7733596\") " pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"
Jul 27 17:54:43.956163 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:43.956146    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmqfv\" (UniqueName: \"kubernetes.io/projected/78b620f1-d4ac-44cb-9932-f91fec0a5e9f-kube-api-access-gmqfv\") pod \"payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr\" (UID: \"78b620f1-d4ac-44cb-9932-f91fec0a5e9f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"
Jul 27 17:54:44.021435 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:44.021396    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"
Jul 27 17:54:44.064129 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:44.064049    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"
Jul 27 17:54:44.105326 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:44.105286    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"
Jul 27 17:54:44.201997 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:44.201967    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"]
Jul 27 17:54:44.204479 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:54:44.204420    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa94a4c2_540d_43f7_9d27_861d5eea696a.slice/crio-012042607ae6cf05b7b79b236a1c0be19481f0ac1e3e89c4d17c02fbe231aa5c WatchSource:0}: Error finding container 012042607ae6cf05b7b79b236a1c0be19481f0ac1e3e89c4d17c02fbe231aa5c: Status 404 returned error can't find the container with id 012042607ae6cf05b7b79b236a1c0be19481f0ac1e3e89c4d17c02fbe231aa5c
Jul 27 17:54:44.205913 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:44.205867    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:54:44.268665 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:44.268641    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"]
Jul 27 17:54:44.270885 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:54:44.270860    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78b620f1_d4ac_44cb_9932_f91fec0a5e9f.slice/crio-92b9a62276dffcb6fde86b8bd7f0d5e030c7c3e07263f0380a4ce8d2365fd755 WatchSource:0}: Error finding container 92b9a62276dffcb6fde86b8bd7f0d5e030c7c3e07263f0380a4ce8d2365fd755: Status 404 returned error can't find the container with id 92b9a62276dffcb6fde86b8bd7f0d5e030c7c3e07263f0380a4ce8d2365fd755
Jul 27 17:54:44.441396 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:44.441345    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"]
Jul 27 17:54:44.444360 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:54:44.444325    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd30a223_16ec_4993_a722_ff44e7733596.slice/crio-2977cb086af9dcef52d650954c7c0ada0f23f3621a5044adb15c74e164c1b322 WatchSource:0}: Error finding container 2977cb086af9dcef52d650954c7c0ada0f23f3621a5044adb15c74e164c1b322: Status 404 returned error can't find the container with id 2977cb086af9dcef52d650954c7c0ada0f23f3621a5044adb15c74e164c1b322
Jul 27 17:54:44.560976 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:44.560938    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq" event={"ID":"fd30a223-16ec-4993-a722-ff44e7733596","Type":"ContainerStarted","Data":"8da9e0ab1d056d858dda4fd7f7debf2e42196482216034da4df215416906b388"}
Jul 27 17:54:44.561177 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:44.561001    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq" event={"ID":"fd30a223-16ec-4993-a722-ff44e7733596","Type":"ContainerStarted","Data":"2977cb086af9dcef52d650954c7c0ada0f23f3621a5044adb15c74e164c1b322"}
Jul 27 17:54:44.561249 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:44.561214    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"
Jul 27 17:54:44.562840 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:44.562795    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884" event={"ID":"fa94a4c2-540d-43f7-9d27-861d5eea696a","Type":"ContainerStarted","Data":"012042607ae6cf05b7b79b236a1c0be19481f0ac1e3e89c4d17c02fbe231aa5c"}
Jul 27 17:54:44.564565 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:44.564536    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr" event={"ID":"78b620f1-d4ac-44cb-9932-f91fec0a5e9f","Type":"ContainerStarted","Data":"80429c4fc6aa880e2729875385859c9da44988758f45950fa41429d19a80e1d4"}
Jul 27 17:54:44.564677 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:44.564606    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr" event={"ID":"78b620f1-d4ac-44cb-9932-f91fec0a5e9f","Type":"ContainerStarted","Data":"92b9a62276dffcb6fde86b8bd7f0d5e030c7c3e07263f0380a4ce8d2365fd755"}
Jul 27 17:54:44.564767 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:44.564754    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"
Jul 27 17:54:44.582117 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:44.582021    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq" podStartSLOduration=1.582002184 podStartE2EDuration="1.582002184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:54:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:54:44.5792687 +0000 UTC m=+1827.593935146" watchObservedRunningTime="2026-07-27 17:54:44.582002184 +0000 UTC m=+1827.596668627"
Jul 27 17:54:44.599285 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:44.599231    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr" podStartSLOduration=1.5992191629999999 podStartE2EDuration="1.599219163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:54:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:54:44.598400377 +0000 UTC m=+1827.613066818" watchObservedRunningTime="2026-07-27 17:54:44.599219163 +0000 UTC m=+1827.613885624"
Jul 27 17:54:45.571230 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:45.571191    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884" event={"ID":"fa94a4c2-540d-43f7-9d27-861d5eea696a","Type":"ContainerStarted","Data":"2068dedb4f4d4991e0db7fe8ff869f0c7ccb481c76ddc9cf80d10b3cddd4ccd7"}
Jul 27 17:54:45.571636 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:45.571389    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"
Jul 27 17:54:45.589484 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:45.589429    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884" podStartSLOduration=2.18462017 podStartE2EDuration="2.589413405s" totalImagesPullingTime="404.793235ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:54:45.587399272 +0000 UTC m=+1828.602065715" watchObservedRunningTime="2026-07-27 17:54:45.589413405 +0000 UTC m=+1828.604079849"
Jul 27 17:54:51.581819 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:51.581786    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"
Jul 27 17:54:55.573718 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:55.573685    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"
Jul 27 17:54:55.574122 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:55.573891    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"
Jul 27 17:54:56.630425 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:56.630394    2580 generic.go:356] "Generic (PLEG): container finished" podID="a604a286-7dc4-4a49-add9-bac393ea26f4" containerID="b40aa6ead730d6d1ad9d50c050273a440f973f7271a4b6eb7e33f119929b334f" exitCode=0
Jul 27 17:54:56.630776 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:56.630463    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2" event={"ID":"a604a286-7dc4-4a49-add9-bac393ea26f4","Type":"ContainerDied","Data":"b40aa6ead730d6d1ad9d50c050273a440f973f7271a4b6eb7e33f119929b334f"}
Jul 27 17:54:56.630882 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:56.630868    2580 scope.go:117] "RemoveContainer" containerID="b40aa6ead730d6d1ad9d50c050273a440f973f7271a4b6eb7e33f119929b334f"
Jul 27 17:54:56.631866 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:56.631837    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:54:56.631931 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:56.631918    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:54:56.631967 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:56.631952    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:54:57.637270 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:57.637235    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2" event={"ID":"a604a286-7dc4-4a49-add9-bac393ea26f4","Type":"ContainerStarted","Data":"f958b486296149bc5b481f1d84190c1da8ba6ca16063b1dd534656c32182f818"}
Jul 27 17:54:57.939765 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:57.939733    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:57.941270 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:57.941239    2580 patch_prober.go:28] interesting pod/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 27 17:54:57.941524 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:57.941481    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2" podUID="a604a286-7dc4-4a49-add9-bac393ea26f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 27 17:54:58.554562 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:58.554521    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:54:58.940916 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:58.940879    2580 patch_prober.go:28] interesting pod/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 27 17:54:58.941951 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:58.941491    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2" podUID="a604a286-7dc4-4a49-add9-bac393ea26f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 27 17:54:59.940389 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:59.940354    2580 patch_prober.go:28] interesting pod/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 27 17:54:59.940725 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:54:59.940696    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2" podUID="a604a286-7dc4-4a49-add9-bac393ea26f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 27 17:55:00.940615 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:00.940558    2580 patch_prober.go:28] interesting pod/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 27 17:55:00.941121 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:00.940646    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2" podUID="a604a286-7dc4-4a49-add9-bac393ea26f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 27 17:55:01.944401 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:01.944369    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:55:01.945617 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:01.945573    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:55:18.795531 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:18.795496    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"]
Jul 27 17:55:18.796098 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:18.795729    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884" podUID="fa94a4c2-540d-43f7-9d27-861d5eea696a" containerName="maas-api" containerID="cri-o://2068dedb4f4d4991e0db7fe8ff869f0c7ccb481c76ddc9cf80d10b3cddd4ccd7" gracePeriod=30
Jul 27 17:55:18.844787 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:18.844755    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"]
Jul 27 17:55:18.845059 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:18.845007    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq" podUID="fd30a223-16ec-4993-a722-ff44e7733596" containerName="payload-processing" containerID="cri-o://8da9e0ab1d056d858dda4fd7f7debf2e42196482216034da4df215416906b388" gracePeriod=30
Jul 27 17:55:18.852735 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:18.852712    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"]
Jul 27 17:55:18.852907 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:18.852885    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr" podUID="78b620f1-d4ac-44cb-9932-f91fec0a5e9f" containerName="payload-pre-processing" containerID="cri-o://80429c4fc6aa880e2729875385859c9da44988758f45950fa41429d19a80e1d4" gracePeriod=30
Jul 27 17:55:19.132514 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.132485    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"
Jul 27 17:55:19.136519 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.136493    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"
Jul 27 17:55:19.158905 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.158881    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"
Jul 27 17:55:19.173509 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.173482    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd30a223-16ec-4993-a722-ff44e7733596-plugins-config-volume\") pod \"fd30a223-16ec-4993-a722-ff44e7733596\" (UID: \"fd30a223-16ec-4993-a722-ff44e7733596\") "
Jul 27 17:55:19.173676 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.173516    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa94a4c2-540d-43f7-9d27-861d5eea696a-openshift-service-ca\") pod \"fa94a4c2-540d-43f7-9d27-861d5eea696a\" (UID: \"fa94a4c2-540d-43f7-9d27-861d5eea696a\") "
Jul 27 17:55:19.173676 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.173651    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmqfv\" (UniqueName: \"kubernetes.io/projected/78b620f1-d4ac-44cb-9932-f91fec0a5e9f-kube-api-access-gmqfv\") pod \"78b620f1-d4ac-44cb-9932-f91fec0a5e9f\" (UID: \"78b620f1-d4ac-44cb-9932-f91fec0a5e9f\") "
Jul 27 17:55:19.173820 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.173700    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78b620f1-d4ac-44cb-9932-f91fec0a5e9f-plugins-config-volume\") pod \"78b620f1-d4ac-44cb-9932-f91fec0a5e9f\" (UID: \"78b620f1-d4ac-44cb-9932-f91fec0a5e9f\") "
Jul 27 17:55:19.173820 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.173755    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa94a4c2-540d-43f7-9d27-861d5eea696a-maas-api-tls\") pod \"fa94a4c2-540d-43f7-9d27-861d5eea696a\" (UID: \"fa94a4c2-540d-43f7-9d27-861d5eea696a\") "
Jul 27 17:55:19.173917 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.173830    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkww8\" (UniqueName: \"kubernetes.io/projected/fa94a4c2-540d-43f7-9d27-861d5eea696a-kube-api-access-rkww8\") pod \"fa94a4c2-540d-43f7-9d27-861d5eea696a\" (UID: \"fa94a4c2-540d-43f7-9d27-861d5eea696a\") "
Jul 27 17:55:19.173917 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.173857    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb9vv\" (UniqueName: \"kubernetes.io/projected/fd30a223-16ec-4993-a722-ff44e7733596-kube-api-access-wb9vv\") pod \"fd30a223-16ec-4993-a722-ff44e7733596\" (UID: \"fd30a223-16ec-4993-a722-ff44e7733596\") "
Jul 27 17:55:19.173917 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.173864    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa94a4c2-540d-43f7-9d27-861d5eea696a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fa94a4c2-540d-43f7-9d27-861d5eea696a" (UID: "fa94a4c2-540d-43f7-9d27-861d5eea696a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:55:19.174102 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.173931    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd30a223-16ec-4993-a722-ff44e7733596-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fd30a223-16ec-4993-a722-ff44e7733596" (UID: "fd30a223-16ec-4993-a722-ff44e7733596"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:55:19.174214 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.174182    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78b620f1-d4ac-44cb-9932-f91fec0a5e9f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "78b620f1-d4ac-44cb-9932-f91fec0a5e9f" (UID: "78b620f1-d4ac-44cb-9932-f91fec0a5e9f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:55:19.174375 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.174257    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa94a4c2-540d-43f7-9d27-861d5eea696a-openshift-service-ca\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:55:19.174375 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.174277    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd30a223-16ec-4993-a722-ff44e7733596-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:55:19.176398 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.176367    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa94a4c2-540d-43f7-9d27-861d5eea696a-kube-api-access-rkww8" (OuterVolumeSpecName: "kube-api-access-rkww8") pod "fa94a4c2-540d-43f7-9d27-861d5eea696a" (UID: "fa94a4c2-540d-43f7-9d27-861d5eea696a"). InnerVolumeSpecName "kube-api-access-rkww8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:55:19.176508 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.176494    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa94a4c2-540d-43f7-9d27-861d5eea696a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fa94a4c2-540d-43f7-9d27-861d5eea696a" (UID: "fa94a4c2-540d-43f7-9d27-861d5eea696a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:55:19.176600 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.176522    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd30a223-16ec-4993-a722-ff44e7733596-kube-api-access-wb9vv" (OuterVolumeSpecName: "kube-api-access-wb9vv") pod "fd30a223-16ec-4993-a722-ff44e7733596" (UID: "fd30a223-16ec-4993-a722-ff44e7733596"). InnerVolumeSpecName "kube-api-access-wb9vv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:55:19.176600 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.176550    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78b620f1-d4ac-44cb-9932-f91fec0a5e9f-kube-api-access-gmqfv" (OuterVolumeSpecName: "kube-api-access-gmqfv") pod "78b620f1-d4ac-44cb-9932-f91fec0a5e9f" (UID: "78b620f1-d4ac-44cb-9932-f91fec0a5e9f"). InnerVolumeSpecName "kube-api-access-gmqfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:55:19.275313 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.275283    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmqfv\" (UniqueName: \"kubernetes.io/projected/78b620f1-d4ac-44cb-9932-f91fec0a5e9f-kube-api-access-gmqfv\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:55:19.275313 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.275309    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78b620f1-d4ac-44cb-9932-f91fec0a5e9f-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:55:19.275313 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.275319    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa94a4c2-540d-43f7-9d27-861d5eea696a-maas-api-tls\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:55:19.275533 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.275328    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkww8\" (UniqueName: \"kubernetes.io/projected/fa94a4c2-540d-43f7-9d27-861d5eea696a-kube-api-access-rkww8\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:55:19.275533 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.275338    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb9vv\" (UniqueName: \"kubernetes.io/projected/fd30a223-16ec-4993-a722-ff44e7733596-kube-api-access-wb9vv\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:55:19.753941 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.753839    2580 generic.go:356] "Generic (PLEG): container finished" podID="78b620f1-d4ac-44cb-9932-f91fec0a5e9f" containerID="80429c4fc6aa880e2729875385859c9da44988758f45950fa41429d19a80e1d4" exitCode=0
Jul 27 17:55:19.753941 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.753892    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"
Jul 27 17:55:19.754167 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.753933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr" event={"ID":"78b620f1-d4ac-44cb-9932-f91fec0a5e9f","Type":"ContainerDied","Data":"80429c4fc6aa880e2729875385859c9da44988758f45950fa41429d19a80e1d4"}
Jul 27 17:55:19.754167 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.753990    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr" event={"ID":"78b620f1-d4ac-44cb-9932-f91fec0a5e9f","Type":"ContainerDied","Data":"92b9a62276dffcb6fde86b8bd7f0d5e030c7c3e07263f0380a4ce8d2365fd755"}
Jul 27 17:55:19.754167 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.754006    2580 scope.go:117] "RemoveContainer" containerID="80429c4fc6aa880e2729875385859c9da44988758f45950fa41429d19a80e1d4"
Jul 27 17:55:19.755433 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.755407    2580 generic.go:356] "Generic (PLEG): container finished" podID="fd30a223-16ec-4993-a722-ff44e7733596" containerID="8da9e0ab1d056d858dda4fd7f7debf2e42196482216034da4df215416906b388" exitCode=0
Jul 27 17:55:19.755541 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.755464    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"
Jul 27 17:55:19.755541 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.755503    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq" event={"ID":"fd30a223-16ec-4993-a722-ff44e7733596","Type":"ContainerDied","Data":"8da9e0ab1d056d858dda4fd7f7debf2e42196482216034da4df215416906b388"}
Jul 27 17:55:19.755684 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.755548    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq" event={"ID":"fd30a223-16ec-4993-a722-ff44e7733596","Type":"ContainerDied","Data":"2977cb086af9dcef52d650954c7c0ada0f23f3621a5044adb15c74e164c1b322"}
Jul 27 17:55:19.757323 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.757296    2580 generic.go:356] "Generic (PLEG): container finished" podID="fa94a4c2-540d-43f7-9d27-861d5eea696a" containerID="2068dedb4f4d4991e0db7fe8ff869f0c7ccb481c76ddc9cf80d10b3cddd4ccd7" exitCode=0
Jul 27 17:55:19.757441 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.757331    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884" event={"ID":"fa94a4c2-540d-43f7-9d27-861d5eea696a","Type":"ContainerDied","Data":"2068dedb4f4d4991e0db7fe8ff869f0c7ccb481c76ddc9cf80d10b3cddd4ccd7"}
Jul 27 17:55:19.757441 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.757347    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"
Jul 27 17:55:19.757441 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.757368    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884" event={"ID":"fa94a4c2-540d-43f7-9d27-861d5eea696a","Type":"ContainerDied","Data":"012042607ae6cf05b7b79b236a1c0be19481f0ac1e3e89c4d17c02fbe231aa5c"}
Jul 27 17:55:19.764205 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.764188    2580 scope.go:117] "RemoveContainer" containerID="80429c4fc6aa880e2729875385859c9da44988758f45950fa41429d19a80e1d4"
Jul 27 17:55:19.764465 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:55:19.764445    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80429c4fc6aa880e2729875385859c9da44988758f45950fa41429d19a80e1d4\": container with ID starting with 80429c4fc6aa880e2729875385859c9da44988758f45950fa41429d19a80e1d4 not found: ID does not exist" containerID="80429c4fc6aa880e2729875385859c9da44988758f45950fa41429d19a80e1d4"
Jul 27 17:55:19.764563 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.764470    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80429c4fc6aa880e2729875385859c9da44988758f45950fa41429d19a80e1d4"} err="failed to get container status \"80429c4fc6aa880e2729875385859c9da44988758f45950fa41429d19a80e1d4\": rpc error: code = NotFound desc = could not find container \"80429c4fc6aa880e2729875385859c9da44988758f45950fa41429d19a80e1d4\": container with ID starting with 80429c4fc6aa880e2729875385859c9da44988758f45950fa41429d19a80e1d4 not found: ID does not exist"
Jul 27 17:55:19.764563 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.764488    2580 scope.go:117] "RemoveContainer" containerID="8da9e0ab1d056d858dda4fd7f7debf2e42196482216034da4df215416906b388"
Jul 27 17:55:19.771851 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.771831    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"]
Jul 27 17:55:19.772234 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.772222    2580 scope.go:117] "RemoveContainer" containerID="8da9e0ab1d056d858dda4fd7f7debf2e42196482216034da4df215416906b388"
Jul 27 17:55:19.772484 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:55:19.772468    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8da9e0ab1d056d858dda4fd7f7debf2e42196482216034da4df215416906b388\": container with ID starting with 8da9e0ab1d056d858dda4fd7f7debf2e42196482216034da4df215416906b388 not found: ID does not exist" containerID="8da9e0ab1d056d858dda4fd7f7debf2e42196482216034da4df215416906b388"
Jul 27 17:55:19.772541 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.772488    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8da9e0ab1d056d858dda4fd7f7debf2e42196482216034da4df215416906b388"} err="failed to get container status \"8da9e0ab1d056d858dda4fd7f7debf2e42196482216034da4df215416906b388\": rpc error: code = NotFound desc = could not find container \"8da9e0ab1d056d858dda4fd7f7debf2e42196482216034da4df215416906b388\": container with ID starting with 8da9e0ab1d056d858dda4fd7f7debf2e42196482216034da4df215416906b388 not found: ID does not exist"
Jul 27 17:55:19.772541 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.772507    2580 scope.go:117] "RemoveContainer" containerID="2068dedb4f4d4991e0db7fe8ff869f0c7ccb481c76ddc9cf80d10b3cddd4ccd7"
Jul 27 17:55:19.777639 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.777619    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0bc6c8fc-684ddb9dc6-bckdr"]
Jul 27 17:55:19.780047 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.780030    2580 scope.go:117] "RemoveContainer" containerID="2068dedb4f4d4991e0db7fe8ff869f0c7ccb481c76ddc9cf80d10b3cddd4ccd7"
Jul 27 17:55:19.780285 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:55:19.780266    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2068dedb4f4d4991e0db7fe8ff869f0c7ccb481c76ddc9cf80d10b3cddd4ccd7\": container with ID starting with 2068dedb4f4d4991e0db7fe8ff869f0c7ccb481c76ddc9cf80d10b3cddd4ccd7 not found: ID does not exist" containerID="2068dedb4f4d4991e0db7fe8ff869f0c7ccb481c76ddc9cf80d10b3cddd4ccd7"
Jul 27 17:55:19.780330 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.780291    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2068dedb4f4d4991e0db7fe8ff869f0c7ccb481c76ddc9cf80d10b3cddd4ccd7"} err="failed to get container status \"2068dedb4f4d4991e0db7fe8ff869f0c7ccb481c76ddc9cf80d10b3cddd4ccd7\": rpc error: code = NotFound desc = could not find container \"2068dedb4f4d4991e0db7fe8ff869f0c7ccb481c76ddc9cf80d10b3cddd4ccd7\": container with ID starting with 2068dedb4f4d4991e0db7fe8ff869f0c7ccb481c76ddc9cf80d10b3cddd4ccd7 not found: ID does not exist"
Jul 27 17:55:19.794313 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.794292    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"]
Jul 27 17:55:19.796623 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.796602    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0bc6c8fc-54bfdd7997-xr884"]
Jul 27 17:55:19.807682 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.807523    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"]
Jul 27 17:55:19.810342 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:19.810320    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0bc6c8fc-5454594d8b-mf9nq"]
Jul 27 17:55:21.476826 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:21.476794    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78b620f1-d4ac-44cb-9932-f91fec0a5e9f" path="/var/lib/kubelet/pods/78b620f1-d4ac-44cb-9932-f91fec0a5e9f/volumes"
Jul 27 17:55:21.477312 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:21.477295    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa94a4c2-540d-43f7-9d27-861d5eea696a" path="/var/lib/kubelet/pods/fa94a4c2-540d-43f7-9d27-861d5eea696a/volumes"
Jul 27 17:55:21.477659 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:21.477646    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd30a223-16ec-4993-a722-ff44e7733596" path="/var/lib/kubelet/pods/fd30a223-16ec-4993-a722-ff44e7733596/volumes"
Jul 27 17:55:23.644876 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:23.644837    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"]
Jul 27 17:55:23.645402 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:23.645142    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2" podUID="a604a286-7dc4-4a49-add9-bac393ea26f4" containerName="istio-proxy" containerID="cri-o://f958b486296149bc5b481f1d84190c1da8ba6ca16063b1dd534656c32182f818" gracePeriod=30
Jul 27 17:55:24.635191 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.635154    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"]
Jul 27 17:55:24.635541 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.635527    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd30a223-16ec-4993-a722-ff44e7733596" containerName="payload-processing"
Jul 27 17:55:24.635650 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.635542    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd30a223-16ec-4993-a722-ff44e7733596" containerName="payload-processing"
Jul 27 17:55:24.635650 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.635553    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa94a4c2-540d-43f7-9d27-861d5eea696a" containerName="maas-api"
Jul 27 17:55:24.635650 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.635559    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa94a4c2-540d-43f7-9d27-861d5eea696a" containerName="maas-api"
Jul 27 17:55:24.635650 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.635571    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78b620f1-d4ac-44cb-9932-f91fec0a5e9f" containerName="payload-pre-processing"
Jul 27 17:55:24.635650 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.635576    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="78b620f1-d4ac-44cb-9932-f91fec0a5e9f" containerName="payload-pre-processing"
Jul 27 17:55:24.635809 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.635662    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="78b620f1-d4ac-44cb-9932-f91fec0a5e9f" containerName="payload-pre-processing"
Jul 27 17:55:24.635809 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.635672    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd30a223-16ec-4993-a722-ff44e7733596" containerName="payload-processing"
Jul 27 17:55:24.635809 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.635680    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa94a4c2-540d-43f7-9d27-861d5eea696a" containerName="maas-api"
Jul 27 17:55:24.639766 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.639745    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.642507 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.642483    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-83680a8c-gw-openshift-default-dockercfg-cvj7n\""
Jul 27 17:55:24.652447 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.652422    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"]
Jul 27 17:55:24.721625 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.721564    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ec343db-e97d-4de5-8a80-66859c7df720-istio-podinfo\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.721839 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.721714    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-istio-data\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.721839 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.721762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ec343db-e97d-4de5-8a80-66859c7df720-istiod-ca-cert\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.721839 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.721805    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ec343db-e97d-4de5-8a80-66859c7df720-istio-token\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.721839 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.721828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-workload-certs\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.722082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.721935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-istio-envoy\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.722082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.721979    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l26vd\" (UniqueName: \"kubernetes.io/projected/7ec343db-e97d-4de5-8a80-66859c7df720-kube-api-access-l26vd\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.722082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.722016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-workload-socket\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.722082 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.722061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-credential-socket\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.823246 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.823215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-istio-data\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.823246 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.823249    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ec343db-e97d-4de5-8a80-66859c7df720-istiod-ca-cert\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.823499 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.823269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ec343db-e97d-4de5-8a80-66859c7df720-istio-token\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.823499 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.823291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-workload-certs\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.823499 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.823364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-istio-envoy\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.823499 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.823394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l26vd\" (UniqueName: \"kubernetes.io/projected/7ec343db-e97d-4de5-8a80-66859c7df720-kube-api-access-l26vd\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.823499 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.823422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-workload-socket\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.823499 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.823460    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-credential-socket\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.823499 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.823493    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ec343db-e97d-4de5-8a80-66859c7df720-istio-podinfo\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.823899 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.823687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-istio-data\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.823899 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.823781    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-workload-certs\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.824008 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.823939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-credential-socket\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.824008 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.823984    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-workload-socket\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.824008 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.823995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ec343db-e97d-4de5-8a80-66859c7df720-istiod-ca-cert\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.832229 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.825999    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ec343db-e97d-4de5-8a80-66859c7df720-istio-podinfo\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.832229 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.826076    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-istio-envoy\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.834116 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.834090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ec343db-e97d-4de5-8a80-66859c7df720-istio-token\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.834615 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.834573    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l26vd\" (UniqueName: \"kubernetes.io/projected/7ec343db-e97d-4de5-8a80-66859c7df720-kube-api-access-l26vd\") pod \"e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") " pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:24.950433 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:24.950399    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:25.089449 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:25.089417    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"]
Jul 27 17:55:25.090754 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:55:25.090729    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec343db_e97d_4de5_8a80_66859c7df720.slice/crio-5264d0fda4cf60b5a9bf9536d6e5a024d2f7002ad4f9918682ff656e439806ea WatchSource:0}: Error finding container 5264d0fda4cf60b5a9bf9536d6e5a024d2f7002ad4f9918682ff656e439806ea: Status 404 returned error can't find the container with id 5264d0fda4cf60b5a9bf9536d6e5a024d2f7002ad4f9918682ff656e439806ea
Jul 27 17:55:25.092956 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:25.092913    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:55:25.093026 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:25.093011    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:55:25.093068 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:25.093053    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:55:25.793981 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:25.793936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs" event={"ID":"7ec343db-e97d-4de5-8a80-66859c7df720","Type":"ContainerStarted","Data":"5d969d4f9f74c5c8e423c1e36262a4a777c7f17be1a43f8e22c4bb14aea63e74"}
Jul 27 17:55:25.794367 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:25.794027    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs" event={"ID":"7ec343db-e97d-4de5-8a80-66859c7df720","Type":"ContainerStarted","Data":"5264d0fda4cf60b5a9bf9536d6e5a024d2f7002ad4f9918682ff656e439806ea"}
Jul 27 17:55:25.819254 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:25.819197    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs" podStartSLOduration=1.81917737 podStartE2EDuration="1.81917737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:55:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:55:25.816738246 +0000 UTC m=+1868.831404691" watchObservedRunningTime="2026-07-27 17:55:25.81917737 +0000 UTC m=+1868.833843816"
Jul 27 17:55:25.950862 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:25.950823    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:26.956154 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:26.956119    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:27.496652 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:27.496616    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"]
Jul 27 17:55:27.500154 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:27.500132    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"
Jul 27 17:55:27.503403 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:27.503380    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-83680a8c-serving-cert\""
Jul 27 17:55:27.514002 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:27.513979    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"]
Jul 27 17:55:27.547819 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:27.547797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c050d3b0-457a-422e-9819-1ac46b4153c1-maas-api-tls\") pod \"maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt\" (UID: \"c050d3b0-457a-422e-9819-1ac46b4153c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"
Jul 27 17:55:27.547933 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:27.547866    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c050d3b0-457a-422e-9819-1ac46b4153c1-openshift-service-ca\") pod \"maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt\" (UID: \"c050d3b0-457a-422e-9819-1ac46b4153c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"
Jul 27 17:55:27.547933 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:27.547909    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jcpg\" (UniqueName: \"kubernetes.io/projected/c050d3b0-457a-422e-9819-1ac46b4153c1-kube-api-access-7jcpg\") pod \"maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt\" (UID: \"c050d3b0-457a-422e-9819-1ac46b4153c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"
Jul 27 17:55:27.649316 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:27.649280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c050d3b0-457a-422e-9819-1ac46b4153c1-maas-api-tls\") pod \"maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt\" (UID: \"c050d3b0-457a-422e-9819-1ac46b4153c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"
Jul 27 17:55:27.649473 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:27.649342    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c050d3b0-457a-422e-9819-1ac46b4153c1-openshift-service-ca\") pod \"maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt\" (UID: \"c050d3b0-457a-422e-9819-1ac46b4153c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"
Jul 27 17:55:27.649473 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:27.649389    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jcpg\" (UniqueName: \"kubernetes.io/projected/c050d3b0-457a-422e-9819-1ac46b4153c1-kube-api-access-7jcpg\") pod \"maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt\" (UID: \"c050d3b0-457a-422e-9819-1ac46b4153c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"
Jul 27 17:55:27.649473 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:55:27.649425    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-serving-cert: secret "maas-api-e2e-migrate-83680a8c-serving-cert" not found
Jul 27 17:55:27.649642 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:55:27.649492    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c050d3b0-457a-422e-9819-1ac46b4153c1-maas-api-tls podName:c050d3b0-457a-422e-9819-1ac46b4153c1 nodeName:}" failed. No retries permitted until 2026-07-27 17:55:28.149474906 +0000 UTC m=+1871.164141330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c050d3b0-457a-422e-9819-1ac46b4153c1-maas-api-tls") pod "maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt" (UID: "c050d3b0-457a-422e-9819-1ac46b4153c1") : secret "maas-api-e2e-migrate-83680a8c-serving-cert" not found
Jul 27 17:55:27.649966 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:27.649948    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c050d3b0-457a-422e-9819-1ac46b4153c1-openshift-service-ca\") pod \"maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt\" (UID: \"c050d3b0-457a-422e-9819-1ac46b4153c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"
Jul 27 17:55:27.660372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:27.660349    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jcpg\" (UniqueName: \"kubernetes.io/projected/c050d3b0-457a-422e-9819-1ac46b4153c1-kube-api-access-7jcpg\") pod \"maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt\" (UID: \"c050d3b0-457a-422e-9819-1ac46b4153c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"
Jul 27 17:55:27.804636 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:27.804527    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:27.805649 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:27.805626    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:28.154036 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.154007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c050d3b0-457a-422e-9819-1ac46b4153c1-maas-api-tls\") pod \"maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt\" (UID: \"c050d3b0-457a-422e-9819-1ac46b4153c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"
Jul 27 17:55:28.156445 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.156420    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c050d3b0-457a-422e-9819-1ac46b4153c1-maas-api-tls\") pod \"maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt\" (UID: \"c050d3b0-457a-422e-9819-1ac46b4153c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"
Jul 27 17:55:28.198725 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.198693    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"]
Jul 27 17:55:28.202477 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.202460    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"
Jul 27 17:55:28.206287 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.206268    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-83680a8c-dockercfg-crzj2\""
Jul 27 17:55:28.206287 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.206279    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-83680a8c\""
Jul 27 17:55:28.215091 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.214088    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"]
Jul 27 17:55:28.239247 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.239216    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"]
Jul 27 17:55:28.242819 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.242800    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"
Jul 27 17:55:28.253799 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.253774    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"]
Jul 27 17:55:28.255116 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.255090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e27c4c3a-2d89-4e49-89cb-ffaa76202bf7-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g\" (UID: \"e27c4c3a-2d89-4e49-89cb-ffaa76202bf7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"
Jul 27 17:55:28.255252 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.255228    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm8r9\" (UniqueName: \"kubernetes.io/projected/e27c4c3a-2d89-4e49-89cb-ffaa76202bf7-kube-api-access-wm8r9\") pod \"payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g\" (UID: \"e27c4c3a-2d89-4e49-89cb-ffaa76202bf7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"
Jul 27 17:55:28.356542 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.356498    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm8r9\" (UniqueName: \"kubernetes.io/projected/e27c4c3a-2d89-4e49-89cb-ffaa76202bf7-kube-api-access-wm8r9\") pod \"payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g\" (UID: \"e27c4c3a-2d89-4e49-89cb-ffaa76202bf7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"
Jul 27 17:55:28.356741 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.356615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e27c4c3a-2d89-4e49-89cb-ffaa76202bf7-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g\" (UID: \"e27c4c3a-2d89-4e49-89cb-ffaa76202bf7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"
Jul 27 17:55:28.356741 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.356653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51a6492b-2ec6-47c3-a6bb-1332f11538e7-plugins-config-volume\") pod \"payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq\" (UID: \"51a6492b-2ec6-47c3-a6bb-1332f11538e7\") " pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"
Jul 27 17:55:28.356741 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.356718    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhblg\" (UniqueName: \"kubernetes.io/projected/51a6492b-2ec6-47c3-a6bb-1332f11538e7-kube-api-access-qhblg\") pod \"payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq\" (UID: \"51a6492b-2ec6-47c3-a6bb-1332f11538e7\") " pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"
Jul 27 17:55:28.357356 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.357334    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e27c4c3a-2d89-4e49-89cb-ffaa76202bf7-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g\" (UID: \"e27c4c3a-2d89-4e49-89cb-ffaa76202bf7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"
Jul 27 17:55:28.365324 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.365295    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm8r9\" (UniqueName: \"kubernetes.io/projected/e27c4c3a-2d89-4e49-89cb-ffaa76202bf7-kube-api-access-wm8r9\") pod \"payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g\" (UID: \"e27c4c3a-2d89-4e49-89cb-ffaa76202bf7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"
Jul 27 17:55:28.412636 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.412552    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"
Jul 27 17:55:28.458317 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.458224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51a6492b-2ec6-47c3-a6bb-1332f11538e7-plugins-config-volume\") pod \"payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq\" (UID: \"51a6492b-2ec6-47c3-a6bb-1332f11538e7\") " pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"
Jul 27 17:55:28.458500 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.458322    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhblg\" (UniqueName: \"kubernetes.io/projected/51a6492b-2ec6-47c3-a6bb-1332f11538e7-kube-api-access-qhblg\") pod \"payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq\" (UID: \"51a6492b-2ec6-47c3-a6bb-1332f11538e7\") " pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"
Jul 27 17:55:28.458922 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.458900    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51a6492b-2ec6-47c3-a6bb-1332f11538e7-plugins-config-volume\") pod \"payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq\" (UID: \"51a6492b-2ec6-47c3-a6bb-1332f11538e7\") " pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"
Jul 27 17:55:28.467555 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.467292    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhblg\" (UniqueName: \"kubernetes.io/projected/51a6492b-2ec6-47c3-a6bb-1332f11538e7-kube-api-access-qhblg\") pod \"payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq\" (UID: \"51a6492b-2ec6-47c3-a6bb-1332f11538e7\") " pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"
Jul 27 17:55:28.515948 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.515906    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"
Jul 27 17:55:28.553760 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.553733    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"
Jul 27 17:55:28.554477 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.554451    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"]
Jul 27 17:55:28.556195 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:55:28.556167    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc050d3b0_457a_422e_9819_1ac46b4153c1.slice/crio-b649f5cdb73cae231b884f397da7eaf182c1beeddab4d04cba8066de616bda66 WatchSource:0}: Error finding container b649f5cdb73cae231b884f397da7eaf182c1beeddab4d04cba8066de616bda66: Status 404 returned error can't find the container with id b649f5cdb73cae231b884f397da7eaf182c1beeddab4d04cba8066de616bda66
Jul 27 17:55:28.670787 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.670757    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"]
Jul 27 17:55:28.673326 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:55:28.673292    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode27c4c3a_2d89_4e49_89cb_ffaa76202bf7.slice/crio-80b0aa024f23102ccc1de69f74cf06ff90068fc80b2681b817f200cac1b3de51 WatchSource:0}: Error finding container 80b0aa024f23102ccc1de69f74cf06ff90068fc80b2681b817f200cac1b3de51: Status 404 returned error can't find the container with id 80b0aa024f23102ccc1de69f74cf06ff90068fc80b2681b817f200cac1b3de51
Jul 27 17:55:28.709849 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.709823    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"]
Jul 27 17:55:28.735681 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:55:28.735653    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a6492b_2ec6_47c3_a6bb_1332f11538e7.slice/crio-81a769d0c5766f7c3746f9b6eb8612e9056314986efbbb863902467c01c8033e WatchSource:0}: Error finding container 81a769d0c5766f7c3746f9b6eb8612e9056314986efbbb863902467c01c8033e: Status 404 returned error can't find the container with id 81a769d0c5766f7c3746f9b6eb8612e9056314986efbbb863902467c01c8033e
Jul 27 17:55:28.812461 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.812159    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt" event={"ID":"c050d3b0-457a-422e-9819-1ac46b4153c1","Type":"ContainerStarted","Data":"b649f5cdb73cae231b884f397da7eaf182c1beeddab4d04cba8066de616bda66"}
Jul 27 17:55:28.815611 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.815446    2580 generic.go:356] "Generic (PLEG): container finished" podID="a604a286-7dc4-4a49-add9-bac393ea26f4" containerID="f958b486296149bc5b481f1d84190c1da8ba6ca16063b1dd534656c32182f818" exitCode=0
Jul 27 17:55:28.815611 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.815526    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2" event={"ID":"a604a286-7dc4-4a49-add9-bac393ea26f4","Type":"ContainerDied","Data":"f958b486296149bc5b481f1d84190c1da8ba6ca16063b1dd534656c32182f818"}
Jul 27 17:55:28.815777 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.815619    2580 scope.go:117] "RemoveContainer" containerID="b40aa6ead730d6d1ad9d50c050273a440f973f7271a4b6eb7e33f119929b334f"
Jul 27 17:55:28.817401 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.817370    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq" event={"ID":"51a6492b-2ec6-47c3-a6bb-1332f11538e7","Type":"ContainerStarted","Data":"81a769d0c5766f7c3746f9b6eb8612e9056314986efbbb863902467c01c8033e"}
Jul 27 17:55:28.818737 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.818713    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g" event={"ID":"e27c4c3a-2d89-4e49-89cb-ffaa76202bf7","Type":"ContainerStarted","Data":"80b0aa024f23102ccc1de69f74cf06ff90068fc80b2681b817f200cac1b3de51"}
Jul 27 17:55:28.901783 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.901757    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:55:28.962849 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.962823    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-token\") pod \"a604a286-7dc4-4a49-add9-bac393ea26f4\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") "
Jul 27 17:55:28.962979 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.962866    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-credential-socket\") pod \"a604a286-7dc4-4a49-add9-bac393ea26f4\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") "
Jul 27 17:55:28.962979 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.962909    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-workload-socket\") pod \"a604a286-7dc4-4a49-add9-bac393ea26f4\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") "
Jul 27 17:55:28.962979 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.962941    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-envoy\") pod \"a604a286-7dc4-4a49-add9-bac393ea26f4\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") "
Jul 27 17:55:28.962979 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.962962    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-data\") pod \"a604a286-7dc4-4a49-add9-bac393ea26f4\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") "
Jul 27 17:55:28.963191 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.963031    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a604a286-7dc4-4a49-add9-bac393ea26f4-istiod-ca-cert\") pod \"a604a286-7dc4-4a49-add9-bac393ea26f4\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") "
Jul 27 17:55:28.963191 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.963082    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-podinfo\") pod \"a604a286-7dc4-4a49-add9-bac393ea26f4\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") "
Jul 27 17:55:28.963191 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.963161    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-workload-certs\") pod \"a604a286-7dc4-4a49-add9-bac393ea26f4\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") "
Jul 27 17:55:28.963335 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.963193    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qw9zf\" (UniqueName: \"kubernetes.io/projected/a604a286-7dc4-4a49-add9-bac393ea26f4-kube-api-access-qw9zf\") pod \"a604a286-7dc4-4a49-add9-bac393ea26f4\" (UID: \"a604a286-7dc4-4a49-add9-bac393ea26f4\") "
Jul 27 17:55:28.963335 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.963242    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a604a286-7dc4-4a49-add9-bac393ea26f4" (UID: "a604a286-7dc4-4a49-add9-bac393ea26f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:55:28.963430 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.963386    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a604a286-7dc4-4a49-add9-bac393ea26f4" (UID: "a604a286-7dc4-4a49-add9-bac393ea26f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:55:28.963487 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.963460    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a604a286-7dc4-4a49-add9-bac393ea26f4" (UID: "a604a286-7dc4-4a49-add9-bac393ea26f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:55:28.963546 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.963478    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a604a286-7dc4-4a49-add9-bac393ea26f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a604a286-7dc4-4a49-add9-bac393ea26f4" (UID: "a604a286-7dc4-4a49-add9-bac393ea26f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:55:28.963724 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.963643    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:55:28.963724 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.963667    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:55:28.963724 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.963689    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a604a286-7dc4-4a49-add9-bac393ea26f4-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:55:28.963724 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.963703    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:55:28.964416 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.964382    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "a604a286-7dc4-4a49-add9-bac393ea26f4" (UID: "a604a286-7dc4-4a49-add9-bac393ea26f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:55:28.965658 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.965630    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a604a286-7dc4-4a49-add9-bac393ea26f4-kube-api-access-qw9zf" (OuterVolumeSpecName: "kube-api-access-qw9zf") pod "a604a286-7dc4-4a49-add9-bac393ea26f4" (UID: "a604a286-7dc4-4a49-add9-bac393ea26f4"). InnerVolumeSpecName "kube-api-access-qw9zf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:55:28.965746 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.965687    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a604a286-7dc4-4a49-add9-bac393ea26f4" (UID: "a604a286-7dc4-4a49-add9-bac393ea26f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 17:55:28.965746 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.965714    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "a604a286-7dc4-4a49-add9-bac393ea26f4" (UID: "a604a286-7dc4-4a49-add9-bac393ea26f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:55:28.965746 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:28.965687    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a604a286-7dc4-4a49-add9-bac393ea26f4" (UID: "a604a286-7dc4-4a49-add9-bac393ea26f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:55:29.064446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.064411    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:55:29.064446 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.064446    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:55:29.064709 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.064459    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:55:29.064709 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.064471    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a604a286-7dc4-4a49-add9-bac393ea26f4-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:55:29.064709 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.064485    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qw9zf\" (UniqueName: \"kubernetes.io/projected/a604a286-7dc4-4a49-add9-bac393ea26f4-kube-api-access-qw9zf\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:55:29.825407 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.825294    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt" event={"ID":"c050d3b0-457a-422e-9819-1ac46b4153c1","Type":"ContainerStarted","Data":"75111845cf2838901ce620fc59abe831f43df20f26a23246a9939b0f4b8f68da"}
Jul 27 17:55:29.825407 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.825376    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"
Jul 27 17:55:29.826662 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.826640    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"
Jul 27 17:55:29.826797 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.826644    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2" event={"ID":"a604a286-7dc4-4a49-add9-bac393ea26f4","Type":"ContainerDied","Data":"f4d6ac23776ed70135269a2af18222ebe598265df371b71eeda86676570b9ec9"}
Jul 27 17:55:29.826797 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.826762    2580 scope.go:117] "RemoveContainer" containerID="f958b486296149bc5b481f1d84190c1da8ba6ca16063b1dd534656c32182f818"
Jul 27 17:55:29.828379 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.828359    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq" event={"ID":"51a6492b-2ec6-47c3-a6bb-1332f11538e7","Type":"ContainerStarted","Data":"e1acf2c7e25419c625601299c9150410d87177493878560c7b0f335dafc69021"}
Jul 27 17:55:29.828471 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.828407    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"
Jul 27 17:55:29.830264 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.830209    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g" event={"ID":"e27c4c3a-2d89-4e49-89cb-ffaa76202bf7","Type":"ContainerStarted","Data":"ca2674266782865fa8b7de62e763f7fb63e8cc5a494472a3cd24f1c1c9044b94"}
Jul 27 17:55:29.830371 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.830333    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"
Jul 27 17:55:29.844243 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.844201    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt" podStartSLOduration=2.4727983780000002 podStartE2EDuration="2.844187984s" totalImagesPullingTime="371.389606ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:55:29.84315251 +0000 UTC m=+1872.857818954" watchObservedRunningTime="2026-07-27 17:55:29.844187984 +0000 UTC m=+1872.858854429"
Jul 27 17:55:29.860202 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.860174    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"]
Jul 27 17:55:29.865064 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.865037    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0bc6c8fc-openshift-default-58bc457df4-4nxj2"]
Jul 27 17:55:29.879205 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.879167    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq" podStartSLOduration=1.879154882 podStartE2EDuration="1.879154882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:55:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:55:29.877143371 +0000 UTC m=+1872.891809816" watchObservedRunningTime="2026-07-27 17:55:29.879154882 +0000 UTC m=+1872.893821304"
Jul 27 17:55:29.893191 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:29.893152    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g" podStartSLOduration=1.893140434 podStartE2EDuration="1.893140434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:55:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:55:29.891856191 +0000 UTC m=+1872.906522636" watchObservedRunningTime="2026-07-27 17:55:29.893140434 +0000 UTC m=+1872.907806879"
Jul 27 17:55:31.482970 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:31.482937    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a604a286-7dc4-4a49-add9-bac393ea26f4" path="/var/lib/kubelet/pods/a604a286-7dc4-4a49-add9-bac393ea26f4/volumes"
Jul 27 17:55:35.855922 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:35.855878    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"
Jul 27 17:55:40.839504 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:40.839465    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"
Jul 27 17:55:40.839973 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:40.839616    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"
Jul 27 17:55:40.896362 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:40.896281    2580 generic.go:356] "Generic (PLEG): container finished" podID="7ec343db-e97d-4de5-8a80-66859c7df720" containerID="5d969d4f9f74c5c8e423c1e36262a4a777c7f17be1a43f8e22c4bb14aea63e74" exitCode=0
Jul 27 17:55:40.896362 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:40.896331    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs" event={"ID":"7ec343db-e97d-4de5-8a80-66859c7df720","Type":"ContainerDied","Data":"5d969d4f9f74c5c8e423c1e36262a4a777c7f17be1a43f8e22c4bb14aea63e74"}
Jul 27 17:55:40.896910 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:40.896893    2580 scope.go:117] "RemoveContainer" containerID="5d969d4f9f74c5c8e423c1e36262a4a777c7f17be1a43f8e22c4bb14aea63e74"
Jul 27 17:55:40.898009 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:40.897979    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:55:40.898084 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:40.898050    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:55:40.898121 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:40.898086    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:55:41.903964 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:41.903932    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs" event={"ID":"7ec343db-e97d-4de5-8a80-66859c7df720","Type":"ContainerStarted","Data":"5f261173b64bb595912efde9d1f5ed003ef93a2eb179dbc03693e4e0fdaaffc6"}
Jul 27 17:55:41.951144 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:41.951104    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:41.952362 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:41.952325    2580 patch_prober.go:28] interesting pod/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 27 17:55:41.952504 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:41.952408    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs" podUID="7ec343db-e97d-4de5-8a80-66859c7df720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 27 17:55:42.804630 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:42.804574    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:42.951297 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:42.951257    2580 patch_prober.go:28] interesting pod/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 27 17:55:42.951804 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:42.951334    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs" podUID="7ec343db-e97d-4de5-8a80-66859c7df720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 27 17:55:43.951848 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:43.951810    2580 patch_prober.go:28] interesting pod/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 27 17:55:43.952420 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:43.952390    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs" podUID="7ec343db-e97d-4de5-8a80-66859c7df720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 27 17:55:44.951289 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:44.951252    2580 patch_prober.go:28] interesting pod/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 27 17:55:44.951606 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:44.951558    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs" podUID="7ec343db-e97d-4de5-8a80-66859c7df720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 27 17:55:45.955026 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:45.954995    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:55:45.956003 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:55:45.955981    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:56:02.754807 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:02.754770    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"]
Jul 27 17:56:02.755310 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:02.755090    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt" podUID="c050d3b0-457a-422e-9819-1ac46b4153c1" containerName="maas-api" containerID="cri-o://75111845cf2838901ce620fc59abe831f43df20f26a23246a9939b0f4b8f68da" gracePeriod=30
Jul 27 17:56:02.808247 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:02.808214    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"]
Jul 27 17:56:02.808473 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:02.808448    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq" podUID="51a6492b-2ec6-47c3-a6bb-1332f11538e7" containerName="payload-processing" containerID="cri-o://e1acf2c7e25419c625601299c9150410d87177493878560c7b0f335dafc69021" gracePeriod=30
Jul 27 17:56:02.815658 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:02.815624    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"]
Jul 27 17:56:02.815658 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:02.815819    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g" podUID="e27c4c3a-2d89-4e49-89cb-ffaa76202bf7" containerName="payload-pre-processing" containerID="cri-o://ca2674266782865fa8b7de62e763f7fb63e8cc5a494472a3cd24f1c1c9044b94" gracePeriod=30
Jul 27 17:56:02.885298 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:56:02.885262    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode27c4c3a_2d89_4e49_89cb_ffaa76202bf7.slice/crio-conmon-ca2674266782865fa8b7de62e763f7fb63e8cc5a494472a3cd24f1c1c9044b94.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode27c4c3a_2d89_4e49_89cb_ffaa76202bf7.slice/crio-ca2674266782865fa8b7de62e763f7fb63e8cc5a494472a3cd24f1c1c9044b94.scope\": RecentStats: unable to find data in memory cache]"
Jul 27 17:56:03.013655 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.012030    2580 generic.go:356] "Generic (PLEG): container finished" podID="c050d3b0-457a-422e-9819-1ac46b4153c1" containerID="75111845cf2838901ce620fc59abe831f43df20f26a23246a9939b0f4b8f68da" exitCode=0
Jul 27 17:56:03.013655 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.012109    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt" event={"ID":"c050d3b0-457a-422e-9819-1ac46b4153c1","Type":"ContainerDied","Data":"75111845cf2838901ce620fc59abe831f43df20f26a23246a9939b0f4b8f68da"}
Jul 27 17:56:03.015318 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.015289    2580 generic.go:356] "Generic (PLEG): container finished" podID="51a6492b-2ec6-47c3-a6bb-1332f11538e7" containerID="e1acf2c7e25419c625601299c9150410d87177493878560c7b0f335dafc69021" exitCode=0
Jul 27 17:56:03.015460 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.015399    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq" event={"ID":"51a6492b-2ec6-47c3-a6bb-1332f11538e7","Type":"ContainerDied","Data":"e1acf2c7e25419c625601299c9150410d87177493878560c7b0f335dafc69021"}
Jul 27 17:56:03.017280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.017125    2580 generic.go:356] "Generic (PLEG): container finished" podID="e27c4c3a-2d89-4e49-89cb-ffaa76202bf7" containerID="ca2674266782865fa8b7de62e763f7fb63e8cc5a494472a3cd24f1c1c9044b94" exitCode=0
Jul 27 17:56:03.017280 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.017153    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g" event={"ID":"e27c4c3a-2d89-4e49-89cb-ffaa76202bf7","Type":"ContainerDied","Data":"ca2674266782865fa8b7de62e763f7fb63e8cc5a494472a3cd24f1c1c9044b94"}
Jul 27 17:56:03.093541 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.093518    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"
Jul 27 17:56:03.095710 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.095690    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"
Jul 27 17:56:03.124932 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.124911    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"
Jul 27 17:56:03.179286 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.179261    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jcpg\" (UniqueName: \"kubernetes.io/projected/c050d3b0-457a-422e-9819-1ac46b4153c1-kube-api-access-7jcpg\") pod \"c050d3b0-457a-422e-9819-1ac46b4153c1\" (UID: \"c050d3b0-457a-422e-9819-1ac46b4153c1\") "
Jul 27 17:56:03.179416 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.179292    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhblg\" (UniqueName: \"kubernetes.io/projected/51a6492b-2ec6-47c3-a6bb-1332f11538e7-kube-api-access-qhblg\") pod \"51a6492b-2ec6-47c3-a6bb-1332f11538e7\" (UID: \"51a6492b-2ec6-47c3-a6bb-1332f11538e7\") "
Jul 27 17:56:03.179416 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.179319    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm8r9\" (UniqueName: \"kubernetes.io/projected/e27c4c3a-2d89-4e49-89cb-ffaa76202bf7-kube-api-access-wm8r9\") pod \"e27c4c3a-2d89-4e49-89cb-ffaa76202bf7\" (UID: \"e27c4c3a-2d89-4e49-89cb-ffaa76202bf7\") "
Jul 27 17:56:03.179416 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.179408    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51a6492b-2ec6-47c3-a6bb-1332f11538e7-plugins-config-volume\") pod \"51a6492b-2ec6-47c3-a6bb-1332f11538e7\" (UID: \"51a6492b-2ec6-47c3-a6bb-1332f11538e7\") "
Jul 27 17:56:03.179615 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.179437    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c050d3b0-457a-422e-9819-1ac46b4153c1-maas-api-tls\") pod \"c050d3b0-457a-422e-9819-1ac46b4153c1\" (UID: \"c050d3b0-457a-422e-9819-1ac46b4153c1\") "
Jul 27 17:56:03.179615 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.179483    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c050d3b0-457a-422e-9819-1ac46b4153c1-openshift-service-ca\") pod \"c050d3b0-457a-422e-9819-1ac46b4153c1\" (UID: \"c050d3b0-457a-422e-9819-1ac46b4153c1\") "
Jul 27 17:56:03.179615 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.179506    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e27c4c3a-2d89-4e49-89cb-ffaa76202bf7-plugins-config-volume\") pod \"e27c4c3a-2d89-4e49-89cb-ffaa76202bf7\" (UID: \"e27c4c3a-2d89-4e49-89cb-ffaa76202bf7\") "
Jul 27 17:56:03.179928 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.179880    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c050d3b0-457a-422e-9819-1ac46b4153c1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c050d3b0-457a-422e-9819-1ac46b4153c1" (UID: "c050d3b0-457a-422e-9819-1ac46b4153c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:56:03.179928 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.179891    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a6492b-2ec6-47c3-a6bb-1332f11538e7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "51a6492b-2ec6-47c3-a6bb-1332f11538e7" (UID: "51a6492b-2ec6-47c3-a6bb-1332f11538e7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:56:03.180179 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.180150    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e27c4c3a-2d89-4e49-89cb-ffaa76202bf7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e27c4c3a-2d89-4e49-89cb-ffaa76202bf7" (UID: "e27c4c3a-2d89-4e49-89cb-ffaa76202bf7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:56:03.181595 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.181559    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c050d3b0-457a-422e-9819-1ac46b4153c1-kube-api-access-7jcpg" (OuterVolumeSpecName: "kube-api-access-7jcpg") pod "c050d3b0-457a-422e-9819-1ac46b4153c1" (UID: "c050d3b0-457a-422e-9819-1ac46b4153c1"). InnerVolumeSpecName "kube-api-access-7jcpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:56:03.181684 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.181597    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e27c4c3a-2d89-4e49-89cb-ffaa76202bf7-kube-api-access-wm8r9" (OuterVolumeSpecName: "kube-api-access-wm8r9") pod "e27c4c3a-2d89-4e49-89cb-ffaa76202bf7" (UID: "e27c4c3a-2d89-4e49-89cb-ffaa76202bf7"). InnerVolumeSpecName "kube-api-access-wm8r9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:56:03.181904 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.181871    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c050d3b0-457a-422e-9819-1ac46b4153c1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c050d3b0-457a-422e-9819-1ac46b4153c1" (UID: "c050d3b0-457a-422e-9819-1ac46b4153c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:56:03.181993 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.181873    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51a6492b-2ec6-47c3-a6bb-1332f11538e7-kube-api-access-qhblg" (OuterVolumeSpecName: "kube-api-access-qhblg") pod "51a6492b-2ec6-47c3-a6bb-1332f11538e7" (UID: "51a6492b-2ec6-47c3-a6bb-1332f11538e7"). InnerVolumeSpecName "kube-api-access-qhblg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:56:03.280412 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.280324    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm8r9\" (UniqueName: \"kubernetes.io/projected/e27c4c3a-2d89-4e49-89cb-ffaa76202bf7-kube-api-access-wm8r9\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:03.280412 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.280355    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51a6492b-2ec6-47c3-a6bb-1332f11538e7-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:03.280412 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.280366    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c050d3b0-457a-422e-9819-1ac46b4153c1-maas-api-tls\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:03.280412 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.280376    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c050d3b0-457a-422e-9819-1ac46b4153c1-openshift-service-ca\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:03.280412 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.280384    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e27c4c3a-2d89-4e49-89cb-ffaa76202bf7-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:03.280412 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.280394    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jcpg\" (UniqueName: \"kubernetes.io/projected/c050d3b0-457a-422e-9819-1ac46b4153c1-kube-api-access-7jcpg\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:03.280412 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:03.280403    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhblg\" (UniqueName: \"kubernetes.io/projected/51a6492b-2ec6-47c3-a6bb-1332f11538e7-kube-api-access-qhblg\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:04.024240 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:04.024156    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"
Jul 27 17:56:04.024240 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:04.024196    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g" event={"ID":"e27c4c3a-2d89-4e49-89cb-ffaa76202bf7","Type":"ContainerDied","Data":"80b0aa024f23102ccc1de69f74cf06ff90068fc80b2681b817f200cac1b3de51"}
Jul 27 17:56:04.024755 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:04.024266    2580 scope.go:117] "RemoveContainer" containerID="ca2674266782865fa8b7de62e763f7fb63e8cc5a494472a3cd24f1c1c9044b94"
Jul 27 17:56:04.025526 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:04.025473    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"
Jul 27 17:56:04.025628 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:04.025527    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt" event={"ID":"c050d3b0-457a-422e-9819-1ac46b4153c1","Type":"ContainerDied","Data":"b649f5cdb73cae231b884f397da7eaf182c1beeddab4d04cba8066de616bda66"}
Jul 27 17:56:04.027057 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:04.027037    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq" event={"ID":"51a6492b-2ec6-47c3-a6bb-1332f11538e7","Type":"ContainerDied","Data":"81a769d0c5766f7c3746f9b6eb8612e9056314986efbbb863902467c01c8033e"}
Jul 27 17:56:04.027179 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:04.027061    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"
Jul 27 17:56:04.034081 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:04.034061    2580 scope.go:117] "RemoveContainer" containerID="75111845cf2838901ce620fc59abe831f43df20f26a23246a9939b0f4b8f68da"
Jul 27 17:56:04.041658 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:04.041638    2580 scope.go:117] "RemoveContainer" containerID="e1acf2c7e25419c625601299c9150410d87177493878560c7b0f335dafc69021"
Jul 27 17:56:04.049229 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:04.049209    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"]
Jul 27 17:56:04.052842 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:04.052823    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-83680a8c-6b4db475fd-bv9dt"]
Jul 27 17:56:04.064527 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:04.064504    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"]
Jul 27 17:56:04.068750 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:04.068731    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-83680a8c-c7445cf7-zh2qq"]
Jul 27 17:56:04.079170 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:04.079150    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"]
Jul 27 17:56:04.082521 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:04.082498    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-83680a8c-987f67648-nl75g"]
Jul 27 17:56:05.479360 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:05.479326    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51a6492b-2ec6-47c3-a6bb-1332f11538e7" path="/var/lib/kubelet/pods/51a6492b-2ec6-47c3-a6bb-1332f11538e7/volumes"
Jul 27 17:56:05.479763 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:05.479750    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c050d3b0-457a-422e-9819-1ac46b4153c1" path="/var/lib/kubelet/pods/c050d3b0-457a-422e-9819-1ac46b4153c1/volumes"
Jul 27 17:56:05.480073 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:05.480059    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e27c4c3a-2d89-4e49-89cb-ffaa76202bf7" path="/var/lib/kubelet/pods/e27c4c3a-2d89-4e49-89cb-ffaa76202bf7/volumes"
Jul 27 17:56:07.436496 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:07.436459    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"]
Jul 27 17:56:07.436930 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:07.436682    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs" podUID="7ec343db-e97d-4de5-8a80-66859c7df720" containerName="istio-proxy" containerID="cri-o://5f261173b64bb595912efde9d1f5ed003ef93a2eb179dbc03693e4e0fdaaffc6" gracePeriod=30
Jul 27 17:56:08.206735 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.206704    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"]
Jul 27 17:56:08.207105 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.207091    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a604a286-7dc4-4a49-add9-bac393ea26f4" containerName="istio-proxy"
Jul 27 17:56:08.207155 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.207107    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a604a286-7dc4-4a49-add9-bac393ea26f4" containerName="istio-proxy"
Jul 27 17:56:08.207155 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.207119    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a604a286-7dc4-4a49-add9-bac393ea26f4" containerName="istio-proxy"
Jul 27 17:56:08.207155 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.207124    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a604a286-7dc4-4a49-add9-bac393ea26f4" containerName="istio-proxy"
Jul 27 17:56:08.207155 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.207143    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c050d3b0-457a-422e-9819-1ac46b4153c1" containerName="maas-api"
Jul 27 17:56:08.207155 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.207148    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c050d3b0-457a-422e-9819-1ac46b4153c1" containerName="maas-api"
Jul 27 17:56:08.207155 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.207155    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51a6492b-2ec6-47c3-a6bb-1332f11538e7" containerName="payload-processing"
Jul 27 17:56:08.207343 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.207161    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="51a6492b-2ec6-47c3-a6bb-1332f11538e7" containerName="payload-processing"
Jul 27 17:56:08.207343 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.207172    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e27c4c3a-2d89-4e49-89cb-ffaa76202bf7" containerName="payload-pre-processing"
Jul 27 17:56:08.207343 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.207177    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e27c4c3a-2d89-4e49-89cb-ffaa76202bf7" containerName="payload-pre-processing"
Jul 27 17:56:08.207343 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.207233    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="51a6492b-2ec6-47c3-a6bb-1332f11538e7" containerName="payload-processing"
Jul 27 17:56:08.207343 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.207243    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a604a286-7dc4-4a49-add9-bac393ea26f4" containerName="istio-proxy"
Jul 27 17:56:08.207343 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.207249    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c050d3b0-457a-422e-9819-1ac46b4153c1" containerName="maas-api"
Jul 27 17:56:08.207343 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.207255    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e27c4c3a-2d89-4e49-89cb-ffaa76202bf7" containerName="payload-pre-processing"
Jul 27 17:56:08.207343 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.207261    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a604a286-7dc4-4a49-add9-bac393ea26f4" containerName="istio-proxy"
Jul 27 17:56:08.211555 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.211536    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.212433 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.212401    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-workload-socket\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.212571 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.212449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004fec29-06f7-488c-8050-8f907dfc4fd9-istiod-ca-cert\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.212571 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.212504    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-data\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.212571 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.212544    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-token\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.212785 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.212698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-workload-certs\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.212785 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.212735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-envoy\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.212893 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.212812    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfrmt\" (UniqueName: \"kubernetes.io/projected/004fec29-06f7-488c-8050-8f907dfc4fd9-kube-api-access-xfrmt\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.212893 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.212855    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-credential-socket\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.212988 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.212890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-podinfo\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.214139 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.214120    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-83640ff2-openshift-default-dockercfg-bdqnm\""
Jul 27 17:56:08.222036 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.222013    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"]
Jul 27 17:56:08.313338 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.313304    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004fec29-06f7-488c-8050-8f907dfc4fd9-istiod-ca-cert\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.313338 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.313349    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-data\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.313636 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.313381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-token\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.313636 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.313420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-workload-certs\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.313636 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.313453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-envoy\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.313636 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.313507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfrmt\" (UniqueName: \"kubernetes.io/projected/004fec29-06f7-488c-8050-8f907dfc4fd9-kube-api-access-xfrmt\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.313636 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.313543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-credential-socket\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.313636 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.313602    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-podinfo\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.313975 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.313668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-workload-socket\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.313975 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.313868    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-data\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.314447 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.314423    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-workload-certs\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.314661 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.314634    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-credential-socket\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.314853 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.314722    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-workload-socket\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.315222 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.315196    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004fec29-06f7-488c-8050-8f907dfc4fd9-istiod-ca-cert\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.317296 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.317268    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-envoy\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.317559 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.317532    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-podinfo\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.323012 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.322990    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-token\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.323097 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.323031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfrmt\" (UniqueName: \"kubernetes.io/projected/004fec29-06f7-488c-8050-8f907dfc4fd9-kube-api-access-xfrmt\") pod \"e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") " pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.523229 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.523145    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:08.661122 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.661097    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"]
Jul 27 17:56:08.663180 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:56:08.663150    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod004fec29_06f7_488c_8050_8f907dfc4fd9.slice/crio-06aea133612b9d21471d60b61801c276e36cfcde7f22d09255f39a3bd9cd504f WatchSource:0}: Error finding container 06aea133612b9d21471d60b61801c276e36cfcde7f22d09255f39a3bd9cd504f: Status 404 returned error can't find the container with id 06aea133612b9d21471d60b61801c276e36cfcde7f22d09255f39a3bd9cd504f
Jul 27 17:56:08.665278 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.665247    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:56:08.665383 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.665313    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:56:08.665383 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:08.665342    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:56:09.062336 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:09.062298    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd" event={"ID":"004fec29-06f7-488c-8050-8f907dfc4fd9","Type":"ContainerStarted","Data":"8cd50009b92507e613acf58c78c81cdad3845ab9e2caa7a94bdce7e4cf8575b9"}
Jul 27 17:56:09.062552 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:09.062363    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd" event={"ID":"004fec29-06f7-488c-8050-8f907dfc4fd9","Type":"ContainerStarted","Data":"06aea133612b9d21471d60b61801c276e36cfcde7f22d09255f39a3bd9cd504f"}
Jul 27 17:56:09.085563 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:09.085513    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd" podStartSLOduration=1.085496807 podStartE2EDuration="1.085496807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:56:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:56:09.083467175 +0000 UTC m=+1912.098133622" watchObservedRunningTime="2026-07-27 17:56:09.085496807 +0000 UTC m=+1912.100163250"
Jul 27 17:56:09.523747 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:09.523715    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:09.528649 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:09.528625    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:10.067735 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.067702    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:10.068852 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.068831    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:10.495096 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.495059    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"]
Jul 27 17:56:10.498919 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.498897    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"
Jul 27 17:56:10.501671 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.501650    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-83640ff2-serving-cert\""
Jul 27 17:56:10.509739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.509717    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"]
Jul 27 17:56:10.531481 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.531450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91829f17-6061-478e-b9f8-acddf1402488-maas-api-tls\") pod \"maas-api-e2e-ait-83640ff2-865f9fc75-r5btv\" (UID: \"91829f17-6061-478e-b9f8-acddf1402488\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"
Jul 27 17:56:10.531910 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.531512    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91829f17-6061-478e-b9f8-acddf1402488-openshift-service-ca\") pod \"maas-api-e2e-ait-83640ff2-865f9fc75-r5btv\" (UID: \"91829f17-6061-478e-b9f8-acddf1402488\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"
Jul 27 17:56:10.531910 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.531765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqldf\" (UniqueName: \"kubernetes.io/projected/91829f17-6061-478e-b9f8-acddf1402488-kube-api-access-jqldf\") pod \"maas-api-e2e-ait-83640ff2-865f9fc75-r5btv\" (UID: \"91829f17-6061-478e-b9f8-acddf1402488\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"
Jul 27 17:56:10.633036 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.633004    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91829f17-6061-478e-b9f8-acddf1402488-maas-api-tls\") pod \"maas-api-e2e-ait-83640ff2-865f9fc75-r5btv\" (UID: \"91829f17-6061-478e-b9f8-acddf1402488\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"
Jul 27 17:56:10.633214 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.633070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91829f17-6061-478e-b9f8-acddf1402488-openshift-service-ca\") pod \"maas-api-e2e-ait-83640ff2-865f9fc75-r5btv\" (UID: \"91829f17-6061-478e-b9f8-acddf1402488\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"
Jul 27 17:56:10.633214 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.633118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqldf\" (UniqueName: \"kubernetes.io/projected/91829f17-6061-478e-b9f8-acddf1402488-kube-api-access-jqldf\") pod \"maas-api-e2e-ait-83640ff2-865f9fc75-r5btv\" (UID: \"91829f17-6061-478e-b9f8-acddf1402488\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"
Jul 27 17:56:10.633843 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.633819    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91829f17-6061-478e-b9f8-acddf1402488-openshift-service-ca\") pod \"maas-api-e2e-ait-83640ff2-865f9fc75-r5btv\" (UID: \"91829f17-6061-478e-b9f8-acddf1402488\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"
Jul 27 17:56:10.635612 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.635573    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91829f17-6061-478e-b9f8-acddf1402488-maas-api-tls\") pod \"maas-api-e2e-ait-83640ff2-865f9fc75-r5btv\" (UID: \"91829f17-6061-478e-b9f8-acddf1402488\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"
Jul 27 17:56:10.645128 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.645078    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqldf\" (UniqueName: \"kubernetes.io/projected/91829f17-6061-478e-b9f8-acddf1402488-kube-api-access-jqldf\") pod \"maas-api-e2e-ait-83640ff2-865f9fc75-r5btv\" (UID: \"91829f17-6061-478e-b9f8-acddf1402488\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"
Jul 27 17:56:10.811421 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.811333    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"
Jul 27 17:56:10.952167 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:10.952138    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"]
Jul 27 17:56:10.954366 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:56:10.954326    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91829f17_6061_478e_b9f8_acddf1402488.slice/crio-1ebd09f285afa6df37286901ed55a96ccb177afa485a71a3ffe6bc027c3b5e28 WatchSource:0}: Error finding container 1ebd09f285afa6df37286901ed55a96ccb177afa485a71a3ffe6bc027c3b5e28: Status 404 returned error can't find the container with id 1ebd09f285afa6df37286901ed55a96ccb177afa485a71a3ffe6bc027c3b5e28
Jul 27 17:56:11.072424 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.072348    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"]
Jul 27 17:56:11.077063 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.077036    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv" event={"ID":"91829f17-6061-478e-b9f8-acddf1402488","Type":"ContainerStarted","Data":"1ebd09f285afa6df37286901ed55a96ccb177afa485a71a3ffe6bc027c3b5e28"}
Jul 27 17:56:11.077193 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.077115    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"
Jul 27 17:56:11.081170 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.081151    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-83640ff2-dockercfg-j4stg\""
Jul 27 17:56:11.081295 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.081156    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-83640ff2\""
Jul 27 17:56:11.092120 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.092091    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"]
Jul 27 17:56:11.109768 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.109740    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"]
Jul 27 17:56:11.113206 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.113185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"
Jul 27 17:56:11.121684 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.121661    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"]
Jul 27 17:56:11.138142 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.138117    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7f5b9b-425b-41db-9df2-b7636c088424-plugins-config-volume\") pod \"payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7\" (UID: \"1f7f5b9b-425b-41db-9df2-b7636c088424\") " pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"
Jul 27 17:56:11.138306 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.138283    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpfnn\" (UniqueName: \"kubernetes.io/projected/0e98c14a-1208-4267-a0c6-52007628fe5e-kube-api-access-bpfnn\") pod \"payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr\" (UID: \"0e98c14a-1208-4267-a0c6-52007628fe5e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"
Jul 27 17:56:11.138381 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.138324    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkdmn\" (UniqueName: \"kubernetes.io/projected/1f7f5b9b-425b-41db-9df2-b7636c088424-kube-api-access-mkdmn\") pod \"payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7\" (UID: \"1f7f5b9b-425b-41db-9df2-b7636c088424\") " pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"
Jul 27 17:56:11.138508 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.138485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e98c14a-1208-4267-a0c6-52007628fe5e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr\" (UID: \"0e98c14a-1208-4267-a0c6-52007628fe5e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"
Jul 27 17:56:11.239399 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.239365    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpfnn\" (UniqueName: \"kubernetes.io/projected/0e98c14a-1208-4267-a0c6-52007628fe5e-kube-api-access-bpfnn\") pod \"payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr\" (UID: \"0e98c14a-1208-4267-a0c6-52007628fe5e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"
Jul 27 17:56:11.239399 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.239402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkdmn\" (UniqueName: \"kubernetes.io/projected/1f7f5b9b-425b-41db-9df2-b7636c088424-kube-api-access-mkdmn\") pod \"payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7\" (UID: \"1f7f5b9b-425b-41db-9df2-b7636c088424\") " pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"
Jul 27 17:56:11.239751 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.239473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e98c14a-1208-4267-a0c6-52007628fe5e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr\" (UID: \"0e98c14a-1208-4267-a0c6-52007628fe5e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"
Jul 27 17:56:11.239751 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.239508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7f5b9b-425b-41db-9df2-b7636c088424-plugins-config-volume\") pod \"payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7\" (UID: \"1f7f5b9b-425b-41db-9df2-b7636c088424\") " pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"
Jul 27 17:56:11.240384 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.240359    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7f5b9b-425b-41db-9df2-b7636c088424-plugins-config-volume\") pod \"payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7\" (UID: \"1f7f5b9b-425b-41db-9df2-b7636c088424\") " pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"
Jul 27 17:56:11.240491 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.240381    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e98c14a-1208-4267-a0c6-52007628fe5e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr\" (UID: \"0e98c14a-1208-4267-a0c6-52007628fe5e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"
Jul 27 17:56:11.248445 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.248420    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkdmn\" (UniqueName: \"kubernetes.io/projected/1f7f5b9b-425b-41db-9df2-b7636c088424-kube-api-access-mkdmn\") pod \"payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7\" (UID: \"1f7f5b9b-425b-41db-9df2-b7636c088424\") " pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"
Jul 27 17:56:11.248541 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.248447    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpfnn\" (UniqueName: \"kubernetes.io/projected/0e98c14a-1208-4267-a0c6-52007628fe5e-kube-api-access-bpfnn\") pod \"payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr\" (UID: \"0e98c14a-1208-4267-a0c6-52007628fe5e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"
Jul 27 17:56:11.387626 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.387517    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"
Jul 27 17:56:11.424740 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.424706    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"
Jul 27 17:56:11.534531 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.534502    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"]
Jul 27 17:56:11.537093 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:56:11.537064    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e98c14a_1208_4267_a0c6_52007628fe5e.slice/crio-318556886ccab0da911dea530e9bdbc1c5495fb42bd806553c5445619088f788 WatchSource:0}: Error finding container 318556886ccab0da911dea530e9bdbc1c5495fb42bd806553c5445619088f788: Status 404 returned error can't find the container with id 318556886ccab0da911dea530e9bdbc1c5495fb42bd806553c5445619088f788
Jul 27 17:56:11.786852 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:11.786827    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"]
Jul 27 17:56:11.789602 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:56:11.789555    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7f5b9b_425b_41db_9df2_b7636c088424.slice/crio-edbc57a3ee92ed3a171cf6f48150baa687344e9039b96f6d036986a833e4642d WatchSource:0}: Error finding container edbc57a3ee92ed3a171cf6f48150baa687344e9039b96f6d036986a833e4642d: Status 404 returned error can't find the container with id edbc57a3ee92ed3a171cf6f48150baa687344e9039b96f6d036986a833e4642d
Jul 27 17:56:12.082652 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.082528    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv" event={"ID":"91829f17-6061-478e-b9f8-acddf1402488","Type":"ContainerStarted","Data":"b005d620432e1ea3b48b70594e395e464e88fab0f4cea58cdb2158a6d8b38e9f"}
Jul 27 17:56:12.082652 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.082624    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"
Jul 27 17:56:12.084133 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.084104    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr" event={"ID":"0e98c14a-1208-4267-a0c6-52007628fe5e","Type":"ContainerStarted","Data":"db072a5bd4d1e5b80ee0ff88c128d500e05b12b3897b831b81569c4910f03640"}
Jul 27 17:56:12.084260 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.084146    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr" event={"ID":"0e98c14a-1208-4267-a0c6-52007628fe5e","Type":"ContainerStarted","Data":"318556886ccab0da911dea530e9bdbc1c5495fb42bd806553c5445619088f788"}
Jul 27 17:56:12.084260 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.084172    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"
Jul 27 17:56:12.085694 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.085655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7" event={"ID":"1f7f5b9b-425b-41db-9df2-b7636c088424","Type":"ContainerStarted","Data":"2e775efe802496c6f482620fbd9a547cedb21c5ea3696671a53d8f38122c3e90"}
Jul 27 17:56:12.085810 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.085708    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7" event={"ID":"1f7f5b9b-425b-41db-9df2-b7636c088424","Type":"ContainerStarted","Data":"edbc57a3ee92ed3a171cf6f48150baa687344e9039b96f6d036986a833e4642d"}
Jul 27 17:56:12.129879 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.129834    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr" podStartSLOduration=1.129820338 podStartE2EDuration="1.129820338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:56:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:56:12.128715748 +0000 UTC m=+1915.143382192" watchObservedRunningTime="2026-07-27 17:56:12.129820338 +0000 UTC m=+1915.144486782"
Jul 27 17:56:12.131009 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.130978    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv" podStartSLOduration=1.551908127 podStartE2EDuration="2.1309666s" totalImagesPullingTime="579.058473ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:56:12.107823193 +0000 UTC m=+1915.122489649" watchObservedRunningTime="2026-07-27 17:56:12.1309666 +0000 UTC m=+1915.145633065"
Jul 27 17:56:12.162675 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.162628    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7" podStartSLOduration=1.162611818 podStartE2EDuration="1.162611818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:56:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:56:12.160199561 +0000 UTC m=+1915.174866005" watchObservedRunningTime="2026-07-27 17:56:12.162611818 +0000 UTC m=+1915.177278267"
Jul 27 17:56:12.707576 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.707512    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:56:12.756201 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.756161    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ec343db-e97d-4de5-8a80-66859c7df720-istio-podinfo\") pod \"7ec343db-e97d-4de5-8a80-66859c7df720\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") "
Jul 27 17:56:12.756201 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.756209    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-workload-certs\") pod \"7ec343db-e97d-4de5-8a80-66859c7df720\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") "
Jul 27 17:56:12.756432 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.756240    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l26vd\" (UniqueName: \"kubernetes.io/projected/7ec343db-e97d-4de5-8a80-66859c7df720-kube-api-access-l26vd\") pod \"7ec343db-e97d-4de5-8a80-66859c7df720\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") "
Jul 27 17:56:12.756432 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.756384    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ec343db-e97d-4de5-8a80-66859c7df720-istiod-ca-cert\") pod \"7ec343db-e97d-4de5-8a80-66859c7df720\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") "
Jul 27 17:56:12.756542 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.756464    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-istio-data\") pod \"7ec343db-e97d-4de5-8a80-66859c7df720\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") "
Jul 27 17:56:12.756542 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.756485    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7ec343db-e97d-4de5-8a80-66859c7df720" (UID: "7ec343db-e97d-4de5-8a80-66859c7df720"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:56:12.756542 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.756495    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-istio-envoy\") pod \"7ec343db-e97d-4de5-8a80-66859c7df720\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") "
Jul 27 17:56:12.756728 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.756562    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-credential-socket\") pod \"7ec343db-e97d-4de5-8a80-66859c7df720\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") "
Jul 27 17:56:12.756728 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.756616    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-workload-socket\") pod \"7ec343db-e97d-4de5-8a80-66859c7df720\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") "
Jul 27 17:56:12.756728 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.756660    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ec343db-e97d-4de5-8a80-66859c7df720-istio-token\") pod \"7ec343db-e97d-4de5-8a80-66859c7df720\" (UID: \"7ec343db-e97d-4de5-8a80-66859c7df720\") "
Jul 27 17:56:12.758085 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.757005    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7ec343db-e97d-4de5-8a80-66859c7df720" (UID: "7ec343db-e97d-4de5-8a80-66859c7df720"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:56:12.758085 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.757018    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:12.758085 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.757290    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7ec343db-e97d-4de5-8a80-66859c7df720" (UID: "7ec343db-e97d-4de5-8a80-66859c7df720"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:56:12.758085 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.757871    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-istio-data" (OuterVolumeSpecName: "istio-data") pod "7ec343db-e97d-4de5-8a80-66859c7df720" (UID: "7ec343db-e97d-4de5-8a80-66859c7df720"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:56:12.758085 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.758052    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ec343db-e97d-4de5-8a80-66859c7df720-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7ec343db-e97d-4de5-8a80-66859c7df720" (UID: "7ec343db-e97d-4de5-8a80-66859c7df720"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:56:12.758994 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.758970    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ec343db-e97d-4de5-8a80-66859c7df720-kube-api-access-l26vd" (OuterVolumeSpecName: "kube-api-access-l26vd") pod "7ec343db-e97d-4de5-8a80-66859c7df720" (UID: "7ec343db-e97d-4de5-8a80-66859c7df720"). InnerVolumeSpecName "kube-api-access-l26vd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:56:12.759086 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.759015    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7ec343db-e97d-4de5-8a80-66859c7df720-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7ec343db-e97d-4de5-8a80-66859c7df720" (UID: "7ec343db-e97d-4de5-8a80-66859c7df720"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 17:56:12.759481 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.759456    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ec343db-e97d-4de5-8a80-66859c7df720-istio-token" (OuterVolumeSpecName: "istio-token") pod "7ec343db-e97d-4de5-8a80-66859c7df720" (UID: "7ec343db-e97d-4de5-8a80-66859c7df720"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:56:12.759621 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.759478    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7ec343db-e97d-4de5-8a80-66859c7df720" (UID: "7ec343db-e97d-4de5-8a80-66859c7df720"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:56:12.857898 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.857869    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ec343db-e97d-4de5-8a80-66859c7df720-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:12.857898 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.857895    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l26vd\" (UniqueName: \"kubernetes.io/projected/7ec343db-e97d-4de5-8a80-66859c7df720-kube-api-access-l26vd\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:12.858076 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.857906    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ec343db-e97d-4de5-8a80-66859c7df720-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:12.858076 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.857915    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:12.858076 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.857934    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:12.858076 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.857942    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:12.858076 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.857951    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ec343db-e97d-4de5-8a80-66859c7df720-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:12.858076 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:12.857959    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ec343db-e97d-4de5-8a80-66859c7df720-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:13.092667 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:13.092554    2580 generic.go:356] "Generic (PLEG): container finished" podID="7ec343db-e97d-4de5-8a80-66859c7df720" containerID="5f261173b64bb595912efde9d1f5ed003ef93a2eb179dbc03693e4e0fdaaffc6" exitCode=0
Jul 27 17:56:13.092667 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:13.092624    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"
Jul 27 17:56:13.092667 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:13.092638    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs" event={"ID":"7ec343db-e97d-4de5-8a80-66859c7df720","Type":"ContainerDied","Data":"5f261173b64bb595912efde9d1f5ed003ef93a2eb179dbc03693e4e0fdaaffc6"}
Jul 27 17:56:13.092951 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:13.092720    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs" event={"ID":"7ec343db-e97d-4de5-8a80-66859c7df720","Type":"ContainerDied","Data":"5264d0fda4cf60b5a9bf9536d6e5a024d2f7002ad4f9918682ff656e439806ea"}
Jul 27 17:56:13.092951 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:13.092745    2580 scope.go:117] "RemoveContainer" containerID="5f261173b64bb595912efde9d1f5ed003ef93a2eb179dbc03693e4e0fdaaffc6"
Jul 27 17:56:13.092951 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:13.092915    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"
Jul 27 17:56:13.102119 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:13.102102    2580 scope.go:117] "RemoveContainer" containerID="5d969d4f9f74c5c8e423c1e36262a4a777c7f17be1a43f8e22c4bb14aea63e74"
Jul 27 17:56:13.110305 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:13.110286    2580 scope.go:117] "RemoveContainer" containerID="5f261173b64bb595912efde9d1f5ed003ef93a2eb179dbc03693e4e0fdaaffc6"
Jul 27 17:56:13.110559 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:56:13.110542    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f261173b64bb595912efde9d1f5ed003ef93a2eb179dbc03693e4e0fdaaffc6\": container with ID starting with 5f261173b64bb595912efde9d1f5ed003ef93a2eb179dbc03693e4e0fdaaffc6 not found: ID does not exist" containerID="5f261173b64bb595912efde9d1f5ed003ef93a2eb179dbc03693e4e0fdaaffc6"
Jul 27 17:56:13.110621 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:13.110567    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f261173b64bb595912efde9d1f5ed003ef93a2eb179dbc03693e4e0fdaaffc6"} err="failed to get container status \"5f261173b64bb595912efde9d1f5ed003ef93a2eb179dbc03693e4e0fdaaffc6\": rpc error: code = NotFound desc = could not find container \"5f261173b64bb595912efde9d1f5ed003ef93a2eb179dbc03693e4e0fdaaffc6\": container with ID starting with 5f261173b64bb595912efde9d1f5ed003ef93a2eb179dbc03693e4e0fdaaffc6 not found: ID does not exist"
Jul 27 17:56:13.110621 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:13.110599    2580 scope.go:117] "RemoveContainer" containerID="5d969d4f9f74c5c8e423c1e36262a4a777c7f17be1a43f8e22c4bb14aea63e74"
Jul 27 17:56:13.110812 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:56:13.110791    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d969d4f9f74c5c8e423c1e36262a4a777c7f17be1a43f8e22c4bb14aea63e74\": container with ID starting with 5d969d4f9f74c5c8e423c1e36262a4a777c7f17be1a43f8e22c4bb14aea63e74 not found: ID does not exist" containerID="5d969d4f9f74c5c8e423c1e36262a4a777c7f17be1a43f8e22c4bb14aea63e74"
Jul 27 17:56:13.110854 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:13.110820    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d969d4f9f74c5c8e423c1e36262a4a777c7f17be1a43f8e22c4bb14aea63e74"} err="failed to get container status \"5d969d4f9f74c5c8e423c1e36262a4a777c7f17be1a43f8e22c4bb14aea63e74\": rpc error: code = NotFound desc = could not find container \"5d969d4f9f74c5c8e423c1e36262a4a777c7f17be1a43f8e22c4bb14aea63e74\": container with ID starting with 5d969d4f9f74c5c8e423c1e36262a4a777c7f17be1a43f8e22c4bb14aea63e74 not found: ID does not exist"
Jul 27 17:56:13.115416 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:13.115397    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"]
Jul 27 17:56:13.120924 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:13.120904    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-83680a8c-gw-openshift-default-7968d58756-6zjhs"]
Jul 27 17:56:13.477431 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:13.477389    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ec343db-e97d-4de5-8a80-66859c7df720" path="/var/lib/kubelet/pods/7ec343db-e97d-4de5-8a80-66859c7df720/volumes"
Jul 27 17:56:18.098737 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:18.098660    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"
Jul 27 17:56:23.095020 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:23.094970    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr" podUID="0e98c14a-1208-4267-a0c6-52007628fe5e" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.60:9004: connect: connection refused"
Jul 27 17:56:24.101622 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:24.101590    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"
Jul 27 17:56:25.110759 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:25.109620    2580 patch_prober.go:28] interesting pod/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": read tcp 10.132.0.2:32772->10.132.0.58:15021: read: connection reset by peer" start-of-body=
Jul 27 17:56:25.110759 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:25.109699    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd" podUID="004fec29-06f7-488c-8050-8f907dfc4fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": read tcp 10.132.0.2:32772->10.132.0.58:15021: read: connection reset by peer"
Jul 27 17:56:25.156699 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:25.156672    2580 generic.go:356] "Generic (PLEG): container finished" podID="004fec29-06f7-488c-8050-8f907dfc4fd9" containerID="8cd50009b92507e613acf58c78c81cdad3845ab9e2caa7a94bdce7e4cf8575b9" exitCode=0
Jul 27 17:56:25.156814 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:25.156745    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd" event={"ID":"004fec29-06f7-488c-8050-8f907dfc4fd9","Type":"ContainerDied","Data":"8cd50009b92507e613acf58c78c81cdad3845ab9e2caa7a94bdce7e4cf8575b9"}
Jul 27 17:56:25.157137 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:25.157124    2580 scope.go:117] "RemoveContainer" containerID="8cd50009b92507e613acf58c78c81cdad3845ab9e2caa7a94bdce7e4cf8575b9"
Jul 27 17:56:25.158115 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:25.158087    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:56:25.158180 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:25.158167    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:56:25.158217 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:25.158206    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:56:26.166644 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:26.166608    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd" event={"ID":"004fec29-06f7-488c-8050-8f907dfc4fd9","Type":"ContainerStarted","Data":"7136f160f193dd2a6c9ea2f1ad533acbc3a2f50009dfbcbc69a4e6824ea91ffd"}
Jul 27 17:56:26.524294 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:26.524204    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:26.524445 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:26.524324    2580 patch_prober.go:28] interesting pod/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 27 17:56:26.524445 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:26.524371    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd" podUID="004fec29-06f7-488c-8050-8f907dfc4fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 27 17:56:27.523830 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:27.523792    2580 patch_prober.go:28] interesting pod/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 27 17:56:27.524223 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:27.523843    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd" podUID="004fec29-06f7-488c-8050-8f907dfc4fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 27 17:56:28.524062 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:28.524021    2580 patch_prober.go:28] interesting pod/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 27 17:56:28.524532 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:28.524082    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd" podUID="004fec29-06f7-488c-8050-8f907dfc4fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 27 17:56:29.524040 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:29.524001    2580 patch_prober.go:28] interesting pod/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 27 17:56:29.524225 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:29.524061    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd" podUID="004fec29-06f7-488c-8050-8f907dfc4fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 27 17:56:30.527420 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:30.527388    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:30.527852 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:30.527684    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:30.528227 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:30.528209    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:33.094046 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:33.094016    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"
Jul 27 17:56:46.520607 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.516223    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"]
Jul 27 17:56:46.520607 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.516471    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv" podUID="91829f17-6061-478e-b9f8-acddf1402488" containerName="maas-api" containerID="cri-o://b005d620432e1ea3b48b70594e395e464e88fab0f4cea58cdb2158a6d8b38e9f" gracePeriod=30
Jul 27 17:56:46.569902 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.569866    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"]
Jul 27 17:56:46.570149 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.570121    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7" podUID="1f7f5b9b-425b-41db-9df2-b7636c088424" containerName="payload-processing" containerID="cri-o://2e775efe802496c6f482620fbd9a547cedb21c5ea3696671a53d8f38122c3e90" gracePeriod=30
Jul 27 17:56:46.577028 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.576999    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"]
Jul 27 17:56:46.577292 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.577253    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr" podUID="0e98c14a-1208-4267-a0c6-52007628fe5e" containerName="payload-pre-processing" containerID="cri-o://db072a5bd4d1e5b80ee0ff88c128d500e05b12b3897b831b81569c4910f03640" gracePeriod=30
Jul 27 17:56:46.846102 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.846072    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"
Jul 27 17:56:46.887519 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.887492    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"
Jul 27 17:56:46.890625 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.890575    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"
Jul 27 17:56:46.989263 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.989230    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpfnn\" (UniqueName: \"kubernetes.io/projected/0e98c14a-1208-4267-a0c6-52007628fe5e-kube-api-access-bpfnn\") pod \"0e98c14a-1208-4267-a0c6-52007628fe5e\" (UID: \"0e98c14a-1208-4267-a0c6-52007628fe5e\") "
Jul 27 17:56:46.989455 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.989297    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqldf\" (UniqueName: \"kubernetes.io/projected/91829f17-6061-478e-b9f8-acddf1402488-kube-api-access-jqldf\") pod \"91829f17-6061-478e-b9f8-acddf1402488\" (UID: \"91829f17-6061-478e-b9f8-acddf1402488\") "
Jul 27 17:56:46.989455 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.989350    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7f5b9b-425b-41db-9df2-b7636c088424-plugins-config-volume\") pod \"1f7f5b9b-425b-41db-9df2-b7636c088424\" (UID: \"1f7f5b9b-425b-41db-9df2-b7636c088424\") "
Jul 27 17:56:46.989455 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.989378    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91829f17-6061-478e-b9f8-acddf1402488-maas-api-tls\") pod \"91829f17-6061-478e-b9f8-acddf1402488\" (UID: \"91829f17-6061-478e-b9f8-acddf1402488\") "
Jul 27 17:56:46.989455 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.989394    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkdmn\" (UniqueName: \"kubernetes.io/projected/1f7f5b9b-425b-41db-9df2-b7636c088424-kube-api-access-mkdmn\") pod \"1f7f5b9b-425b-41db-9df2-b7636c088424\" (UID: \"1f7f5b9b-425b-41db-9df2-b7636c088424\") "
Jul 27 17:56:46.989455 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.989410    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e98c14a-1208-4267-a0c6-52007628fe5e-plugins-config-volume\") pod \"0e98c14a-1208-4267-a0c6-52007628fe5e\" (UID: \"0e98c14a-1208-4267-a0c6-52007628fe5e\") "
Jul 27 17:56:46.989455 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.989441    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91829f17-6061-478e-b9f8-acddf1402488-openshift-service-ca\") pod \"91829f17-6061-478e-b9f8-acddf1402488\" (UID: \"91829f17-6061-478e-b9f8-acddf1402488\") "
Jul 27 17:56:46.989835 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.989806    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f7f5b9b-425b-41db-9df2-b7636c088424-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f7f5b9b-425b-41db-9df2-b7636c088424" (UID: "1f7f5b9b-425b-41db-9df2-b7636c088424"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:56:46.989900 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.989862    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e98c14a-1208-4267-a0c6-52007628fe5e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0e98c14a-1208-4267-a0c6-52007628fe5e" (UID: "0e98c14a-1208-4267-a0c6-52007628fe5e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:56:46.990100 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.990060    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91829f17-6061-478e-b9f8-acddf1402488-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "91829f17-6061-478e-b9f8-acddf1402488" (UID: "91829f17-6061-478e-b9f8-acddf1402488"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:56:46.991592 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.991538    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f7f5b9b-425b-41db-9df2-b7636c088424-kube-api-access-mkdmn" (OuterVolumeSpecName: "kube-api-access-mkdmn") pod "1f7f5b9b-425b-41db-9df2-b7636c088424" (UID: "1f7f5b9b-425b-41db-9df2-b7636c088424"). InnerVolumeSpecName "kube-api-access-mkdmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:56:46.991592 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.991567    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91829f17-6061-478e-b9f8-acddf1402488-kube-api-access-jqldf" (OuterVolumeSpecName: "kube-api-access-jqldf") pod "91829f17-6061-478e-b9f8-acddf1402488" (UID: "91829f17-6061-478e-b9f8-acddf1402488"). InnerVolumeSpecName "kube-api-access-jqldf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:56:46.991937 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.991912    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91829f17-6061-478e-b9f8-acddf1402488-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "91829f17-6061-478e-b9f8-acddf1402488" (UID: "91829f17-6061-478e-b9f8-acddf1402488"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:56:46.991987 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:46.991921    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e98c14a-1208-4267-a0c6-52007628fe5e-kube-api-access-bpfnn" (OuterVolumeSpecName: "kube-api-access-bpfnn") pod "0e98c14a-1208-4267-a0c6-52007628fe5e" (UID: "0e98c14a-1208-4267-a0c6-52007628fe5e"). InnerVolumeSpecName "kube-api-access-bpfnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:56:47.090440 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.090361    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7f5b9b-425b-41db-9df2-b7636c088424-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:47.090440 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.090389    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91829f17-6061-478e-b9f8-acddf1402488-maas-api-tls\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:47.090440 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.090398    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkdmn\" (UniqueName: \"kubernetes.io/projected/1f7f5b9b-425b-41db-9df2-b7636c088424-kube-api-access-mkdmn\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:47.090440 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.090408    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e98c14a-1208-4267-a0c6-52007628fe5e-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:47.090440 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.090417    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91829f17-6061-478e-b9f8-acddf1402488-openshift-service-ca\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:47.090440 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.090425    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpfnn\" (UniqueName: \"kubernetes.io/projected/0e98c14a-1208-4267-a0c6-52007628fe5e-kube-api-access-bpfnn\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:47.090440 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.090434    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqldf\" (UniqueName: \"kubernetes.io/projected/91829f17-6061-478e-b9f8-acddf1402488-kube-api-access-jqldf\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:47.269660 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.269624    2580 generic.go:356] "Generic (PLEG): container finished" podID="91829f17-6061-478e-b9f8-acddf1402488" containerID="b005d620432e1ea3b48b70594e395e464e88fab0f4cea58cdb2158a6d8b38e9f" exitCode=0
Jul 27 17:56:47.269838 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.269686    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"
Jul 27 17:56:47.269838 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.269702    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv" event={"ID":"91829f17-6061-478e-b9f8-acddf1402488","Type":"ContainerDied","Data":"b005d620432e1ea3b48b70594e395e464e88fab0f4cea58cdb2158a6d8b38e9f"}
Jul 27 17:56:47.269838 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.269778    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv" event={"ID":"91829f17-6061-478e-b9f8-acddf1402488","Type":"ContainerDied","Data":"1ebd09f285afa6df37286901ed55a96ccb177afa485a71a3ffe6bc027c3b5e28"}
Jul 27 17:56:47.269838 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.269809    2580 scope.go:117] "RemoveContainer" containerID="b005d620432e1ea3b48b70594e395e464e88fab0f4cea58cdb2158a6d8b38e9f"
Jul 27 17:56:47.271173 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.271149    2580 generic.go:356] "Generic (PLEG): container finished" podID="0e98c14a-1208-4267-a0c6-52007628fe5e" containerID="db072a5bd4d1e5b80ee0ff88c128d500e05b12b3897b831b81569c4910f03640" exitCode=0
Jul 27 17:56:47.271291 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.271200    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"
Jul 27 17:56:47.271291 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.271236    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr" event={"ID":"0e98c14a-1208-4267-a0c6-52007628fe5e","Type":"ContainerDied","Data":"db072a5bd4d1e5b80ee0ff88c128d500e05b12b3897b831b81569c4910f03640"}
Jul 27 17:56:47.271291 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.271287    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr" event={"ID":"0e98c14a-1208-4267-a0c6-52007628fe5e","Type":"ContainerDied","Data":"318556886ccab0da911dea530e9bdbc1c5495fb42bd806553c5445619088f788"}
Jul 27 17:56:47.272524 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.272499    2580 generic.go:356] "Generic (PLEG): container finished" podID="1f7f5b9b-425b-41db-9df2-b7636c088424" containerID="2e775efe802496c6f482620fbd9a547cedb21c5ea3696671a53d8f38122c3e90" exitCode=0
Jul 27 17:56:47.272653 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.272543    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"
Jul 27 17:56:47.272653 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.272568    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7" event={"ID":"1f7f5b9b-425b-41db-9df2-b7636c088424","Type":"ContainerDied","Data":"2e775efe802496c6f482620fbd9a547cedb21c5ea3696671a53d8f38122c3e90"}
Jul 27 17:56:47.272744 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.272705    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7" event={"ID":"1f7f5b9b-425b-41db-9df2-b7636c088424","Type":"ContainerDied","Data":"edbc57a3ee92ed3a171cf6f48150baa687344e9039b96f6d036986a833e4642d"}
Jul 27 17:56:47.280564 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.280472    2580 scope.go:117] "RemoveContainer" containerID="b005d620432e1ea3b48b70594e395e464e88fab0f4cea58cdb2158a6d8b38e9f"
Jul 27 17:56:47.280822 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:56:47.280796    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b005d620432e1ea3b48b70594e395e464e88fab0f4cea58cdb2158a6d8b38e9f\": container with ID starting with b005d620432e1ea3b48b70594e395e464e88fab0f4cea58cdb2158a6d8b38e9f not found: ID does not exist" containerID="b005d620432e1ea3b48b70594e395e464e88fab0f4cea58cdb2158a6d8b38e9f"
Jul 27 17:56:47.280894 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.280836    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b005d620432e1ea3b48b70594e395e464e88fab0f4cea58cdb2158a6d8b38e9f"} err="failed to get container status \"b005d620432e1ea3b48b70594e395e464e88fab0f4cea58cdb2158a6d8b38e9f\": rpc error: code = NotFound desc = could not find container \"b005d620432e1ea3b48b70594e395e464e88fab0f4cea58cdb2158a6d8b38e9f\": container with ID starting with b005d620432e1ea3b48b70594e395e464e88fab0f4cea58cdb2158a6d8b38e9f not found: ID does not exist"
Jul 27 17:56:47.280894 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.280854    2580 scope.go:117] "RemoveContainer" containerID="db072a5bd4d1e5b80ee0ff88c128d500e05b12b3897b831b81569c4910f03640"
Jul 27 17:56:47.288952 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.288937    2580 scope.go:117] "RemoveContainer" containerID="db072a5bd4d1e5b80ee0ff88c128d500e05b12b3897b831b81569c4910f03640"
Jul 27 17:56:47.289156 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:56:47.289138    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db072a5bd4d1e5b80ee0ff88c128d500e05b12b3897b831b81569c4910f03640\": container with ID starting with db072a5bd4d1e5b80ee0ff88c128d500e05b12b3897b831b81569c4910f03640 not found: ID does not exist" containerID="db072a5bd4d1e5b80ee0ff88c128d500e05b12b3897b831b81569c4910f03640"
Jul 27 17:56:47.289219 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.289161    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db072a5bd4d1e5b80ee0ff88c128d500e05b12b3897b831b81569c4910f03640"} err="failed to get container status \"db072a5bd4d1e5b80ee0ff88c128d500e05b12b3897b831b81569c4910f03640\": rpc error: code = NotFound desc = could not find container \"db072a5bd4d1e5b80ee0ff88c128d500e05b12b3897b831b81569c4910f03640\": container with ID starting with db072a5bd4d1e5b80ee0ff88c128d500e05b12b3897b831b81569c4910f03640 not found: ID does not exist"
Jul 27 17:56:47.289219 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.289182    2580 scope.go:117] "RemoveContainer" containerID="2e775efe802496c6f482620fbd9a547cedb21c5ea3696671a53d8f38122c3e90"
Jul 27 17:56:47.296606 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.296577    2580 scope.go:117] "RemoveContainer" containerID="2e775efe802496c6f482620fbd9a547cedb21c5ea3696671a53d8f38122c3e90"
Jul 27 17:56:47.296829 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:56:47.296813    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e775efe802496c6f482620fbd9a547cedb21c5ea3696671a53d8f38122c3e90\": container with ID starting with 2e775efe802496c6f482620fbd9a547cedb21c5ea3696671a53d8f38122c3e90 not found: ID does not exist" containerID="2e775efe802496c6f482620fbd9a547cedb21c5ea3696671a53d8f38122c3e90"
Jul 27 17:56:47.296901 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.296837    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e775efe802496c6f482620fbd9a547cedb21c5ea3696671a53d8f38122c3e90"} err="failed to get container status \"2e775efe802496c6f482620fbd9a547cedb21c5ea3696671a53d8f38122c3e90\": rpc error: code = NotFound desc = could not find container \"2e775efe802496c6f482620fbd9a547cedb21c5ea3696671a53d8f38122c3e90\": container with ID starting with 2e775efe802496c6f482620fbd9a547cedb21c5ea3696671a53d8f38122c3e90 not found: ID does not exist"
Jul 27 17:56:47.303425 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.303405    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"]
Jul 27 17:56:47.309755 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.309737    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-83640ff2-f5fc5746d-2z6fr"]
Jul 27 17:56:47.322229 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.322212    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"]
Jul 27 17:56:47.326955 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.326935    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-83640ff2-865f9fc75-r5btv"]
Jul 27 17:56:47.338560 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.338535    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"]
Jul 27 17:56:47.342170 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.342107    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-83640ff2-54bb69574-cg7w7"]
Jul 27 17:56:47.476629 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.476576    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e98c14a-1208-4267-a0c6-52007628fe5e" path="/var/lib/kubelet/pods/0e98c14a-1208-4267-a0c6-52007628fe5e/volumes"
Jul 27 17:56:47.476978 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.476965    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f7f5b9b-425b-41db-9df2-b7636c088424" path="/var/lib/kubelet/pods/1f7f5b9b-425b-41db-9df2-b7636c088424/volumes"
Jul 27 17:56:47.477308 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:47.477296    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91829f17-6061-478e-b9f8-acddf1402488" path="/var/lib/kubelet/pods/91829f17-6061-478e-b9f8-acddf1402488/volumes"
Jul 27 17:56:52.395260 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:52.395224    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"]
Jul 27 17:56:52.395761 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:52.395500    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd" podUID="004fec29-06f7-488c-8050-8f907dfc4fd9" containerName="istio-proxy" containerID="cri-o://7136f160f193dd2a6c9ea2f1ad533acbc3a2f50009dfbcbc69a4e6824ea91ffd" gracePeriod=30
Jul 27 17:56:53.141682 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.141647    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"]
Jul 27 17:56:53.142229 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.142209    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ec343db-e97d-4de5-8a80-66859c7df720" containerName="istio-proxy"
Jul 27 17:56:53.142289 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.142234    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ec343db-e97d-4de5-8a80-66859c7df720" containerName="istio-proxy"
Jul 27 17:56:53.142289 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.142251    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f7f5b9b-425b-41db-9df2-b7636c088424" containerName="payload-processing"
Jul 27 17:56:53.142289 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.142260    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f7f5b9b-425b-41db-9df2-b7636c088424" containerName="payload-processing"
Jul 27 17:56:53.142289 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.142275    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e98c14a-1208-4267-a0c6-52007628fe5e" containerName="payload-pre-processing"
Jul 27 17:56:53.142289 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.142285    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e98c14a-1208-4267-a0c6-52007628fe5e" containerName="payload-pre-processing"
Jul 27 17:56:53.142457 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.142301    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91829f17-6061-478e-b9f8-acddf1402488" containerName="maas-api"
Jul 27 17:56:53.142457 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.142310    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="91829f17-6061-478e-b9f8-acddf1402488" containerName="maas-api"
Jul 27 17:56:53.142457 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.142410    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="91829f17-6061-478e-b9f8-acddf1402488" containerName="maas-api"
Jul 27 17:56:53.142457 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.142419    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ec343db-e97d-4de5-8a80-66859c7df720" containerName="istio-proxy"
Jul 27 17:56:53.142457 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.142429    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f7f5b9b-425b-41db-9df2-b7636c088424" containerName="payload-processing"
Jul 27 17:56:53.142457 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.142443    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e98c14a-1208-4267-a0c6-52007628fe5e" containerName="payload-pre-processing"
Jul 27 17:56:53.145498 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.145481    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.148031 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.148013    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-79618e13-openshift-default-dockercfg-cdtxq\""
Jul 27 17:56:53.154325 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.154303    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"]
Jul 27 17:56:53.240992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.240962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istiod-ca-cert\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.241168 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.240996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-workload-certs\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.241168 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.241029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-credential-socket\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.241168 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.241053    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-podinfo\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.241168 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.241104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-token\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.241168 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.241133    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-envoy\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.241168 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.241151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-data\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.241450 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.241172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-workload-socket\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.241450 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.241290    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5czbl\" (UniqueName: \"kubernetes.io/projected/02bf8f2e-039f-439d-ad1c-3efdd14a7584-kube-api-access-5czbl\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.341783 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.341750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istiod-ca-cert\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.341981 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.341790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-workload-certs\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.341981 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.341826    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-credential-socket\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.341981 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.341841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-podinfo\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.341981 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.341868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-token\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.341981 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.341888    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-envoy\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.341981 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.341906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-data\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.342290 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.342238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-workload-socket\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.342359 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.342321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5czbl\" (UniqueName: \"kubernetes.io/projected/02bf8f2e-039f-439d-ad1c-3efdd14a7584-kube-api-access-5czbl\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.342619 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.342569    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istiod-ca-cert\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.342619 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.342608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-workload-certs\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.342783 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.342710    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-credential-socket\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.342783 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.342763    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-workload-socket\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.342853 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.342818    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-data\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.344788 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.344763    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-envoy\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.345011 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.344990    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-podinfo\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.350246 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.350228    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-token\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.350318 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.350243    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5czbl\" (UniqueName: \"kubernetes.io/projected/02bf8f2e-039f-439d-ad1c-3efdd14a7584-kube-api-access-5czbl\") pod \"e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") " pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.456992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.456957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:53.601030 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.601006    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"]
Jul 27 17:56:53.603254 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:56:53.603224    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02bf8f2e_039f_439d_ad1c_3efdd14a7584.slice/crio-10119623ff88b3403a376855c4e7762b8325c9c76c30f116e4ae805bc786b497 WatchSource:0}: Error finding container 10119623ff88b3403a376855c4e7762b8325c9c76c30f116e4ae805bc786b497: Status 404 returned error can't find the container with id 10119623ff88b3403a376855c4e7762b8325c9c76c30f116e4ae805bc786b497
Jul 27 17:56:53.605495 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.605460    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:56:53.605606 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.605528    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:56:53.605606 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:53.605576    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:56:54.312284 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:54.312250    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx" event={"ID":"02bf8f2e-039f-439d-ad1c-3efdd14a7584","Type":"ContainerStarted","Data":"fe65b6b7871def7872d458449978d4de66ce7b1fc87eac45f0bdd78606fb1a16"}
Jul 27 17:56:54.312467 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:54.312307    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx" event={"ID":"02bf8f2e-039f-439d-ad1c-3efdd14a7584","Type":"ContainerStarted","Data":"10119623ff88b3403a376855c4e7762b8325c9c76c30f116e4ae805bc786b497"}
Jul 27 17:56:54.457213 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:54.457178    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:54.462000 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:54.461976    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:54.483629 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:54.483568    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx" podStartSLOduration=1.483554363 podStartE2EDuration="1.483554363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:56:54.341144486 +0000 UTC m=+1957.355810931" watchObservedRunningTime="2026-07-27 17:56:54.483554363 +0000 UTC m=+1957.498220806"
Jul 27 17:56:55.317754 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:55.317719    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:55.318620 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:55.318598    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:56:55.908760 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:55.908729    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"]
Jul 27 17:56:55.909142 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:55.909127    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ec343db-e97d-4de5-8a80-66859c7df720" containerName="istio-proxy"
Jul 27 17:56:55.909142 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:55.909143    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ec343db-e97d-4de5-8a80-66859c7df720" containerName="istio-proxy"
Jul 27 17:56:55.909228 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:55.909211    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ec343db-e97d-4de5-8a80-66859c7df720" containerName="istio-proxy"
Jul 27 17:56:55.912430 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:55.912410    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"
Jul 27 17:56:55.915270 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:55.915247    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-79618e13-serving-cert\""
Jul 27 17:56:55.923989 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:55.923955    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"]
Jul 27 17:56:55.967856 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:55.967831    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlnq2\" (UniqueName: \"kubernetes.io/projected/df284ad0-1e34-4b54-9ff9-ba4716c0c590-kube-api-access-vlnq2\") pod \"maas-api-e2e-derive-79618e13-7cf578b47-f4qgp\" (UID: \"df284ad0-1e34-4b54-9ff9-ba4716c0c590\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"
Jul 27 17:56:55.967985 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:55.967866    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df284ad0-1e34-4b54-9ff9-ba4716c0c590-openshift-service-ca\") pod \"maas-api-e2e-derive-79618e13-7cf578b47-f4qgp\" (UID: \"df284ad0-1e34-4b54-9ff9-ba4716c0c590\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"
Jul 27 17:56:55.967985 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:55.967911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df284ad0-1e34-4b54-9ff9-ba4716c0c590-maas-api-tls\") pod \"maas-api-e2e-derive-79618e13-7cf578b47-f4qgp\" (UID: \"df284ad0-1e34-4b54-9ff9-ba4716c0c590\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"
Jul 27 17:56:56.068720 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.068687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlnq2\" (UniqueName: \"kubernetes.io/projected/df284ad0-1e34-4b54-9ff9-ba4716c0c590-kube-api-access-vlnq2\") pod \"maas-api-e2e-derive-79618e13-7cf578b47-f4qgp\" (UID: \"df284ad0-1e34-4b54-9ff9-ba4716c0c590\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"
Jul 27 17:56:56.068720 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.068726    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df284ad0-1e34-4b54-9ff9-ba4716c0c590-openshift-service-ca\") pod \"maas-api-e2e-derive-79618e13-7cf578b47-f4qgp\" (UID: \"df284ad0-1e34-4b54-9ff9-ba4716c0c590\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"
Jul 27 17:56:56.068929 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.068772    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df284ad0-1e34-4b54-9ff9-ba4716c0c590-maas-api-tls\") pod \"maas-api-e2e-derive-79618e13-7cf578b47-f4qgp\" (UID: \"df284ad0-1e34-4b54-9ff9-ba4716c0c590\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"
Jul 27 17:56:56.069418 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.069399    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df284ad0-1e34-4b54-9ff9-ba4716c0c590-openshift-service-ca\") pod \"maas-api-e2e-derive-79618e13-7cf578b47-f4qgp\" (UID: \"df284ad0-1e34-4b54-9ff9-ba4716c0c590\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"
Jul 27 17:56:56.071251 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.071229    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df284ad0-1e34-4b54-9ff9-ba4716c0c590-maas-api-tls\") pod \"maas-api-e2e-derive-79618e13-7cf578b47-f4qgp\" (UID: \"df284ad0-1e34-4b54-9ff9-ba4716c0c590\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"
Jul 27 17:56:56.079892 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.079872    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlnq2\" (UniqueName: \"kubernetes.io/projected/df284ad0-1e34-4b54-9ff9-ba4716c0c590-kube-api-access-vlnq2\") pod \"maas-api-e2e-derive-79618e13-7cf578b47-f4qgp\" (UID: \"df284ad0-1e34-4b54-9ff9-ba4716c0c590\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"
Jul 27 17:56:56.224660 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.224575    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"
Jul 27 17:56:56.363686 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.363601    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"]
Jul 27 17:56:56.366407 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:56:56.366372    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf284ad0_1e34_4b54_9ff9_ba4716c0c590.slice/crio-fb34148b8bd8abf2141b300afc7bbe58ddfdedd9fcd6cd909727ec65c36ed816 WatchSource:0}: Error finding container fb34148b8bd8abf2141b300afc7bbe58ddfdedd9fcd6cd909727ec65c36ed816: Status 404 returned error can't find the container with id fb34148b8bd8abf2141b300afc7bbe58ddfdedd9fcd6cd909727ec65c36ed816
Jul 27 17:56:56.562791 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.562702    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"]
Jul 27 17:56:56.567549 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.567527    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"
Jul 27 17:56:56.570063 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.570039    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-79618e13\""
Jul 27 17:56:56.570185 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.570130    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-79618e13-dockercfg-cjd2s\""
Jul 27 17:56:56.575562 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.575537    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"]
Jul 27 17:56:56.612627 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.612599    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"]
Jul 27 17:56:56.615986 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.615969    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"
Jul 27 17:56:56.624222 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.624197    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"]
Jul 27 17:56:56.674651 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.674568    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bc1ca71-4e36-4f1a-b977-7c3c5a49a882-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64\" (UID: \"3bc1ca71-4e36-4f1a-b977-7c3c5a49a882\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"
Jul 27 17:56:56.674836 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.674687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53201f42-99e0-4dde-8023-abf9b568fb54-plugins-config-volume\") pod \"payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt\" (UID: \"53201f42-99e0-4dde-8023-abf9b568fb54\") " pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"
Jul 27 17:56:56.674836 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.674728    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp44z\" (UniqueName: \"kubernetes.io/projected/3bc1ca71-4e36-4f1a-b977-7c3c5a49a882-kube-api-access-lp44z\") pod \"payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64\" (UID: \"3bc1ca71-4e36-4f1a-b977-7c3c5a49a882\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"
Jul 27 17:56:56.674836 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.674749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kstzl\" (UniqueName: \"kubernetes.io/projected/53201f42-99e0-4dde-8023-abf9b568fb54-kube-api-access-kstzl\") pod \"payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt\" (UID: \"53201f42-99e0-4dde-8023-abf9b568fb54\") " pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"
Jul 27 17:56:56.775428 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.775391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bc1ca71-4e36-4f1a-b977-7c3c5a49a882-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64\" (UID: \"3bc1ca71-4e36-4f1a-b977-7c3c5a49a882\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"
Jul 27 17:56:56.775632 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.775451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53201f42-99e0-4dde-8023-abf9b568fb54-plugins-config-volume\") pod \"payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt\" (UID: \"53201f42-99e0-4dde-8023-abf9b568fb54\") " pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"
Jul 27 17:56:56.775632 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.775474    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp44z\" (UniqueName: \"kubernetes.io/projected/3bc1ca71-4e36-4f1a-b977-7c3c5a49a882-kube-api-access-lp44z\") pod \"payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64\" (UID: \"3bc1ca71-4e36-4f1a-b977-7c3c5a49a882\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"
Jul 27 17:56:56.775632 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.775611    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kstzl\" (UniqueName: \"kubernetes.io/projected/53201f42-99e0-4dde-8023-abf9b568fb54-kube-api-access-kstzl\") pod \"payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt\" (UID: \"53201f42-99e0-4dde-8023-abf9b568fb54\") " pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"
Jul 27 17:56:56.776251 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.776231    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bc1ca71-4e36-4f1a-b977-7c3c5a49a882-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64\" (UID: \"3bc1ca71-4e36-4f1a-b977-7c3c5a49a882\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"
Jul 27 17:56:56.776372 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.776352    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53201f42-99e0-4dde-8023-abf9b568fb54-plugins-config-volume\") pod \"payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt\" (UID: \"53201f42-99e0-4dde-8023-abf9b568fb54\") " pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"
Jul 27 17:56:56.783487 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.783464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp44z\" (UniqueName: \"kubernetes.io/projected/3bc1ca71-4e36-4f1a-b977-7c3c5a49a882-kube-api-access-lp44z\") pod \"payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64\" (UID: \"3bc1ca71-4e36-4f1a-b977-7c3c5a49a882\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"
Jul 27 17:56:56.783608 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.783515    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kstzl\" (UniqueName: \"kubernetes.io/projected/53201f42-99e0-4dde-8023-abf9b568fb54-kube-api-access-kstzl\") pod \"payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt\" (UID: \"53201f42-99e0-4dde-8023-abf9b568fb54\") " pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"
Jul 27 17:56:56.879167 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.879081    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"
Jul 27 17:56:56.926972 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:56.926942    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"
Jul 27 17:56:57.025481 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.025456    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"]
Jul 27 17:56:57.028609 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:56:57.028522    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc1ca71_4e36_4f1a_b977_7c3c5a49a882.slice/crio-fdd4ac7ef945db8835348a46c2c91b138ee64499cf3b05de4496b1057f5227c3 WatchSource:0}: Error finding container fdd4ac7ef945db8835348a46c2c91b138ee64499cf3b05de4496b1057f5227c3: Status 404 returned error can't find the container with id fdd4ac7ef945db8835348a46c2c91b138ee64499cf3b05de4496b1057f5227c3
Jul 27 17:56:57.085200 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.085167    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"]
Jul 27 17:56:57.085822 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:56:57.085792    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53201f42_99e0_4dde_8023_abf9b568fb54.slice/crio-1b9ff997e84db41e60e1d70f8c28e2ecf84b4b5dd680799386ac13049851f02c WatchSource:0}: Error finding container 1b9ff997e84db41e60e1d70f8c28e2ecf84b4b5dd680799386ac13049851f02c: Status 404 returned error can't find the container with id 1b9ff997e84db41e60e1d70f8c28e2ecf84b4b5dd680799386ac13049851f02c
Jul 27 17:56:57.331411 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.331383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt" event={"ID":"53201f42-99e0-4dde-8023-abf9b568fb54","Type":"ContainerStarted","Data":"3eb1c79c8d016889e249a33b67523e94a23e87d659064f22990df7da23a61804"}
Jul 27 17:56:57.331526 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.331436    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt" event={"ID":"53201f42-99e0-4dde-8023-abf9b568fb54","Type":"ContainerStarted","Data":"1b9ff997e84db41e60e1d70f8c28e2ecf84b4b5dd680799386ac13049851f02c"}
Jul 27 17:56:57.331526 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.331490    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"
Jul 27 17:56:57.332764 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.332742    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp" event={"ID":"df284ad0-1e34-4b54-9ff9-ba4716c0c590","Type":"ContainerStarted","Data":"fb34148b8bd8abf2141b300afc7bbe58ddfdedd9fcd6cd909727ec65c36ed816"}
Jul 27 17:56:57.334185 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.334162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64" event={"ID":"3bc1ca71-4e36-4f1a-b977-7c3c5a49a882","Type":"ContainerStarted","Data":"d13140f242a7bc7b48e907cf93e1326d58d7a4cb092c35087123ddb2d050edae"}
Jul 27 17:56:57.334352 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.334200    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64" event={"ID":"3bc1ca71-4e36-4f1a-b977-7c3c5a49a882","Type":"ContainerStarted","Data":"fdd4ac7ef945db8835348a46c2c91b138ee64499cf3b05de4496b1057f5227c3"}
Jul 27 17:56:57.334352 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.334247    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"
Jul 27 17:56:57.354873 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.354815    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt" podStartSLOduration=1.3547968479999999 podStartE2EDuration="1.354796848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:56:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:56:57.350154796 +0000 UTC m=+1960.364821243" watchObservedRunningTime="2026-07-27 17:56:57.354796848 +0000 UTC m=+1960.369463294"
Jul 27 17:56:57.370984 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.370934    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64" podStartSLOduration=1.370916905 podStartE2EDuration="1.370916905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:56:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:56:57.368536845 +0000 UTC m=+1960.383203291" watchObservedRunningTime="2026-07-27 17:56:57.370916905 +0000 UTC m=+1960.385583351"
Jul 27 17:56:57.647590 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.647552    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:57.686388 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.686320    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-token\") pod \"004fec29-06f7-488c-8050-8f907dfc4fd9\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") "
Jul 27 17:56:57.686388 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.686365    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-workload-certs\") pod \"004fec29-06f7-488c-8050-8f907dfc4fd9\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") "
Jul 27 17:56:57.686611 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.686400    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfrmt\" (UniqueName: \"kubernetes.io/projected/004fec29-06f7-488c-8050-8f907dfc4fd9-kube-api-access-xfrmt\") pod \"004fec29-06f7-488c-8050-8f907dfc4fd9\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") "
Jul 27 17:56:57.686611 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.686419    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-envoy\") pod \"004fec29-06f7-488c-8050-8f907dfc4fd9\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") "
Jul 27 17:56:57.686611 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.686450    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-data\") pod \"004fec29-06f7-488c-8050-8f907dfc4fd9\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") "
Jul 27 17:56:57.686611 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.686512    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-workload-socket\") pod \"004fec29-06f7-488c-8050-8f907dfc4fd9\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") "
Jul 27 17:56:57.686611 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.686537    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-podinfo\") pod \"004fec29-06f7-488c-8050-8f907dfc4fd9\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") "
Jul 27 17:56:57.686611 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.686565    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-credential-socket\") pod \"004fec29-06f7-488c-8050-8f907dfc4fd9\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") "
Jul 27 17:56:57.686945 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.686644    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004fec29-06f7-488c-8050-8f907dfc4fd9-istiod-ca-cert\") pod \"004fec29-06f7-488c-8050-8f907dfc4fd9\" (UID: \"004fec29-06f7-488c-8050-8f907dfc4fd9\") "
Jul 27 17:56:57.686945 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.686660    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "004fec29-06f7-488c-8050-8f907dfc4fd9" (UID: "004fec29-06f7-488c-8050-8f907dfc4fd9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:56:57.686945 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.686811    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "004fec29-06f7-488c-8050-8f907dfc4fd9" (UID: "004fec29-06f7-488c-8050-8f907dfc4fd9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:56:57.687136 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.686970    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:57.687136 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.686991    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:57.687136 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.687129    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/004fec29-06f7-488c-8050-8f907dfc4fd9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "004fec29-06f7-488c-8050-8f907dfc4fd9" (UID: "004fec29-06f7-488c-8050-8f907dfc4fd9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:56:57.687999 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.687706    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "004fec29-06f7-488c-8050-8f907dfc4fd9" (UID: "004fec29-06f7-488c-8050-8f907dfc4fd9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:56:57.687999 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.687954    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-data" (OuterVolumeSpecName: "istio-data") pod "004fec29-06f7-488c-8050-8f907dfc4fd9" (UID: "004fec29-06f7-488c-8050-8f907dfc4fd9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:56:57.689336 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.689304    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/004fec29-06f7-488c-8050-8f907dfc4fd9-kube-api-access-xfrmt" (OuterVolumeSpecName: "kube-api-access-xfrmt") pod "004fec29-06f7-488c-8050-8f907dfc4fd9" (UID: "004fec29-06f7-488c-8050-8f907dfc4fd9"). InnerVolumeSpecName "kube-api-access-xfrmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:56:57.689450 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.689357    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-token" (OuterVolumeSpecName: "istio-token") pod "004fec29-06f7-488c-8050-8f907dfc4fd9" (UID: "004fec29-06f7-488c-8050-8f907dfc4fd9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:56:57.689647 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.689622    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "004fec29-06f7-488c-8050-8f907dfc4fd9" (UID: "004fec29-06f7-488c-8050-8f907dfc4fd9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 17:56:57.689876 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.689858    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "004fec29-06f7-488c-8050-8f907dfc4fd9" (UID: "004fec29-06f7-488c-8050-8f907dfc4fd9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:56:57.787650 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.787620    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:57.787650 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.787650    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:57.787849 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.787659    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:57.787849 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.787668    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004fec29-06f7-488c-8050-8f907dfc4fd9-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:57.787849 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.787677    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004fec29-06f7-488c-8050-8f907dfc4fd9-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:57.787849 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.787685    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004fec29-06f7-488c-8050-8f907dfc4fd9-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:57.787849 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:57.787692    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfrmt\" (UniqueName: \"kubernetes.io/projected/004fec29-06f7-488c-8050-8f907dfc4fd9-kube-api-access-xfrmt\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:56:58.340205 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:58.340108    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp" event={"ID":"df284ad0-1e34-4b54-9ff9-ba4716c0c590","Type":"ContainerStarted","Data":"d2b799ed1fd6bf68d92669ca5e0ecef22df9f925bd3a5ba691a179870d0c5394"}
Jul 27 17:56:58.340731 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:58.340253    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"
Jul 27 17:56:58.350917 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:58.350891    2580 generic.go:356] "Generic (PLEG): container finished" podID="004fec29-06f7-488c-8050-8f907dfc4fd9" containerID="7136f160f193dd2a6c9ea2f1ad533acbc3a2f50009dfbcbc69a4e6824ea91ffd" exitCode=0
Jul 27 17:56:58.351064 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:58.350965    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"
Jul 27 17:56:58.351064 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:58.350981    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd" event={"ID":"004fec29-06f7-488c-8050-8f907dfc4fd9","Type":"ContainerDied","Data":"7136f160f193dd2a6c9ea2f1ad533acbc3a2f50009dfbcbc69a4e6824ea91ffd"}
Jul 27 17:56:58.351187 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:58.351070    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd" event={"ID":"004fec29-06f7-488c-8050-8f907dfc4fd9","Type":"ContainerDied","Data":"06aea133612b9d21471d60b61801c276e36cfcde7f22d09255f39a3bd9cd504f"}
Jul 27 17:56:58.351187 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:58.351099    2580 scope.go:117] "RemoveContainer" containerID="7136f160f193dd2a6c9ea2f1ad533acbc3a2f50009dfbcbc69a4e6824ea91ffd"
Jul 27 17:56:58.360883 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:58.360849    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp" podStartSLOduration=2.414483278 podStartE2EDuration="3.360831699s" totalImagesPullingTime="946.348421ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:56:58.358375755 +0000 UTC m=+1961.373042200" watchObservedRunningTime="2026-07-27 17:56:58.360831699 +0000 UTC m=+1961.375498145"
Jul 27 17:56:58.361407 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:58.361271    2580 scope.go:117] "RemoveContainer" containerID="8cd50009b92507e613acf58c78c81cdad3845ab9e2caa7a94bdce7e4cf8575b9"
Jul 27 17:56:58.369692 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:58.369675    2580 scope.go:117] "RemoveContainer" containerID="7136f160f193dd2a6c9ea2f1ad533acbc3a2f50009dfbcbc69a4e6824ea91ffd"
Jul 27 17:56:58.369942 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:56:58.369924    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7136f160f193dd2a6c9ea2f1ad533acbc3a2f50009dfbcbc69a4e6824ea91ffd\": container with ID starting with 7136f160f193dd2a6c9ea2f1ad533acbc3a2f50009dfbcbc69a4e6824ea91ffd not found: ID does not exist" containerID="7136f160f193dd2a6c9ea2f1ad533acbc3a2f50009dfbcbc69a4e6824ea91ffd"
Jul 27 17:56:58.370006 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:58.369948    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7136f160f193dd2a6c9ea2f1ad533acbc3a2f50009dfbcbc69a4e6824ea91ffd"} err="failed to get container status \"7136f160f193dd2a6c9ea2f1ad533acbc3a2f50009dfbcbc69a4e6824ea91ffd\": rpc error: code = NotFound desc = could not find container \"7136f160f193dd2a6c9ea2f1ad533acbc3a2f50009dfbcbc69a4e6824ea91ffd\": container with ID starting with 7136f160f193dd2a6c9ea2f1ad533acbc3a2f50009dfbcbc69a4e6824ea91ffd not found: ID does not exist"
Jul 27 17:56:58.370006 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:58.369962    2580 scope.go:117] "RemoveContainer" containerID="8cd50009b92507e613acf58c78c81cdad3845ab9e2caa7a94bdce7e4cf8575b9"
Jul 27 17:56:58.370215 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:56:58.370191    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cd50009b92507e613acf58c78c81cdad3845ab9e2caa7a94bdce7e4cf8575b9\": container with ID starting with 8cd50009b92507e613acf58c78c81cdad3845ab9e2caa7a94bdce7e4cf8575b9 not found: ID does not exist" containerID="8cd50009b92507e613acf58c78c81cdad3845ab9e2caa7a94bdce7e4cf8575b9"
Jul 27 17:56:58.370256 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:58.370224    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cd50009b92507e613acf58c78c81cdad3845ab9e2caa7a94bdce7e4cf8575b9"} err="failed to get container status \"8cd50009b92507e613acf58c78c81cdad3845ab9e2caa7a94bdce7e4cf8575b9\": rpc error: code = NotFound desc = could not find container \"8cd50009b92507e613acf58c78c81cdad3845ab9e2caa7a94bdce7e4cf8575b9\": container with ID starting with 8cd50009b92507e613acf58c78c81cdad3845ab9e2caa7a94bdce7e4cf8575b9 not found: ID does not exist"
Jul 27 17:56:58.375795 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:58.375773    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"]
Jul 27 17:56:58.379904 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:58.379884    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-83640ff2-openshift-default-67b6f95f9d-vvccd"]
Jul 27 17:56:59.478134 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:56:59.478105    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="004fec29-06f7-488c-8050-8f907dfc4fd9" path="/var/lib/kubelet/pods/004fec29-06f7-488c-8050-8f907dfc4fd9/volumes"
Jul 27 17:57:04.366804 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:04.366771    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"
Jul 27 17:57:08.353126 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:08.353088    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"
Jul 27 17:57:08.353634 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:08.353183    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"
Jul 27 17:57:09.416455 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:09.416417    2580 generic.go:356] "Generic (PLEG): container finished" podID="02bf8f2e-039f-439d-ad1c-3efdd14a7584" containerID="fe65b6b7871def7872d458449978d4de66ce7b1fc87eac45f0bdd78606fb1a16" exitCode=0
Jul 27 17:57:09.416900 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:09.416474    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx" event={"ID":"02bf8f2e-039f-439d-ad1c-3efdd14a7584","Type":"ContainerDied","Data":"fe65b6b7871def7872d458449978d4de66ce7b1fc87eac45f0bdd78606fb1a16"}
Jul 27 17:57:09.416900 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:09.416892    2580 scope.go:117] "RemoveContainer" containerID="fe65b6b7871def7872d458449978d4de66ce7b1fc87eac45f0bdd78606fb1a16"
Jul 27 17:57:09.417960 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:09.417932    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:57:09.418029 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:09.418002    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:57:09.418066 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:09.418040    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:57:10.318526 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:10.318490    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:57:10.423633 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:10.423573    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx" event={"ID":"02bf8f2e-039f-439d-ad1c-3efdd14a7584","Type":"ContainerStarted","Data":"7938c250970e13c69d3c3ca8a9e01cfe25490e1acc20b987a629f66690401aaa"}
Jul 27 17:57:10.457678 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:10.457573    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:57:10.458484 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:10.458461    2580 patch_prober.go:28] interesting pod/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 27 17:57:10.458604 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:10.458518    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx" podUID="02bf8f2e-039f-439d-ad1c-3efdd14a7584" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 27 17:57:11.458225 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:11.458188    2580 patch_prober.go:28] interesting pod/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 27 17:57:11.458845 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:11.458813    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx" podUID="02bf8f2e-039f-439d-ad1c-3efdd14a7584" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 27 17:57:12.457739 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:12.457695    2580 patch_prober.go:28] interesting pod/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 27 17:57:12.457958 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:12.457762    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx" podUID="02bf8f2e-039f-439d-ad1c-3efdd14a7584" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 27 17:57:13.458482 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:13.458438    2580 patch_prober.go:28] interesting pod/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 27 17:57:13.458995 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:13.458517    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx" podUID="02bf8f2e-039f-439d-ad1c-3efdd14a7584" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 27 17:57:14.458041 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:14.458001    2580 patch_prober.go:28] interesting pod/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 27 17:57:14.458313 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:14.458070    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx" podUID="02bf8f2e-039f-439d-ad1c-3efdd14a7584" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 27 17:57:15.461887 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:15.461857    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:57:15.462287 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:15.462218    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:57:15.462843 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:15.462823    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:57:30.843721 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:30.843690    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"]
Jul 27 17:57:30.844237 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:30.843975    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp" podUID="df284ad0-1e34-4b54-9ff9-ba4716c0c590" containerName="maas-api" containerID="cri-o://d2b799ed1fd6bf68d92669ca5e0ecef22df9f925bd3a5ba691a179870d0c5394" gracePeriod=30
Jul 27 17:57:30.898925 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:30.898893    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"]
Jul 27 17:57:30.899185 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:30.899138    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt" podUID="53201f42-99e0-4dde-8023-abf9b568fb54" containerName="payload-processing" containerID="cri-o://3eb1c79c8d016889e249a33b67523e94a23e87d659064f22990df7da23a61804" gracePeriod=30
Jul 27 17:57:30.903874 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:30.903845    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"]
Jul 27 17:57:30.904198 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:30.904112    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64" podUID="3bc1ca71-4e36-4f1a-b977-7c3c5a49a882" containerName="payload-pre-processing" containerID="cri-o://d13140f242a7bc7b48e907cf93e1326d58d7a4cb092c35087123ddb2d050edae" gracePeriod=30
Jul 27 17:57:31.168350 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.168322    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"
Jul 27 17:57:31.186806 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.186778    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"
Jul 27 17:57:31.221527 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.221501    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"
Jul 27 17:57:31.295737 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.295706    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kstzl\" (UniqueName: \"kubernetes.io/projected/53201f42-99e0-4dde-8023-abf9b568fb54-kube-api-access-kstzl\") pod \"53201f42-99e0-4dde-8023-abf9b568fb54\" (UID: \"53201f42-99e0-4dde-8023-abf9b568fb54\") "
Jul 27 17:57:31.295889 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.295801    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53201f42-99e0-4dde-8023-abf9b568fb54-plugins-config-volume\") pod \"53201f42-99e0-4dde-8023-abf9b568fb54\" (UID: \"53201f42-99e0-4dde-8023-abf9b568fb54\") "
Jul 27 17:57:31.295889 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.295826    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df284ad0-1e34-4b54-9ff9-ba4716c0c590-maas-api-tls\") pod \"df284ad0-1e34-4b54-9ff9-ba4716c0c590\" (UID: \"df284ad0-1e34-4b54-9ff9-ba4716c0c590\") "
Jul 27 17:57:31.295889 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.295871    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlnq2\" (UniqueName: \"kubernetes.io/projected/df284ad0-1e34-4b54-9ff9-ba4716c0c590-kube-api-access-vlnq2\") pod \"df284ad0-1e34-4b54-9ff9-ba4716c0c590\" (UID: \"df284ad0-1e34-4b54-9ff9-ba4716c0c590\") "
Jul 27 17:57:31.295889 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.295888    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df284ad0-1e34-4b54-9ff9-ba4716c0c590-openshift-service-ca\") pod \"df284ad0-1e34-4b54-9ff9-ba4716c0c590\" (UID: \"df284ad0-1e34-4b54-9ff9-ba4716c0c590\") "
Jul 27 17:57:31.296303 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.296274    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53201f42-99e0-4dde-8023-abf9b568fb54-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "53201f42-99e0-4dde-8023-abf9b568fb54" (UID: "53201f42-99e0-4dde-8023-abf9b568fb54"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:57:31.296397 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.296336    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df284ad0-1e34-4b54-9ff9-ba4716c0c590-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "df284ad0-1e34-4b54-9ff9-ba4716c0c590" (UID: "df284ad0-1e34-4b54-9ff9-ba4716c0c590"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:57:31.297797 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.297773    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53201f42-99e0-4dde-8023-abf9b568fb54-kube-api-access-kstzl" (OuterVolumeSpecName: "kube-api-access-kstzl") pod "53201f42-99e0-4dde-8023-abf9b568fb54" (UID: "53201f42-99e0-4dde-8023-abf9b568fb54"). InnerVolumeSpecName "kube-api-access-kstzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:57:31.297982 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.297960    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df284ad0-1e34-4b54-9ff9-ba4716c0c590-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "df284ad0-1e34-4b54-9ff9-ba4716c0c590" (UID: "df284ad0-1e34-4b54-9ff9-ba4716c0c590"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:57:31.298079 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.298015    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df284ad0-1e34-4b54-9ff9-ba4716c0c590-kube-api-access-vlnq2" (OuterVolumeSpecName: "kube-api-access-vlnq2") pod "df284ad0-1e34-4b54-9ff9-ba4716c0c590" (UID: "df284ad0-1e34-4b54-9ff9-ba4716c0c590"). InnerVolumeSpecName "kube-api-access-vlnq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:57:31.396934 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.396846    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bc1ca71-4e36-4f1a-b977-7c3c5a49a882-plugins-config-volume\") pod \"3bc1ca71-4e36-4f1a-b977-7c3c5a49a882\" (UID: \"3bc1ca71-4e36-4f1a-b977-7c3c5a49a882\") "
Jul 27 17:57:31.396934 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.396901    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lp44z\" (UniqueName: \"kubernetes.io/projected/3bc1ca71-4e36-4f1a-b977-7c3c5a49a882-kube-api-access-lp44z\") pod \"3bc1ca71-4e36-4f1a-b977-7c3c5a49a882\" (UID: \"3bc1ca71-4e36-4f1a-b977-7c3c5a49a882\") "
Jul 27 17:57:31.397218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.397092    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df284ad0-1e34-4b54-9ff9-ba4716c0c590-openshift-service-ca\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:57:31.397218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.397105    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kstzl\" (UniqueName: \"kubernetes.io/projected/53201f42-99e0-4dde-8023-abf9b568fb54-kube-api-access-kstzl\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:57:31.397218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.397113    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53201f42-99e0-4dde-8023-abf9b568fb54-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:57:31.397218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.397122    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df284ad0-1e34-4b54-9ff9-ba4716c0c590-maas-api-tls\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:57:31.397218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.397131    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlnq2\" (UniqueName: \"kubernetes.io/projected/df284ad0-1e34-4b54-9ff9-ba4716c0c590-kube-api-access-vlnq2\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:57:31.397218 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.397193    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bc1ca71-4e36-4f1a-b977-7c3c5a49a882-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3bc1ca71-4e36-4f1a-b977-7c3c5a49a882" (UID: "3bc1ca71-4e36-4f1a-b977-7c3c5a49a882"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:57:31.398898 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.398876    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bc1ca71-4e36-4f1a-b977-7c3c5a49a882-kube-api-access-lp44z" (OuterVolumeSpecName: "kube-api-access-lp44z") pod "3bc1ca71-4e36-4f1a-b977-7c3c5a49a882" (UID: "3bc1ca71-4e36-4f1a-b977-7c3c5a49a882"). InnerVolumeSpecName "kube-api-access-lp44z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:57:31.497932 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.497900    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bc1ca71-4e36-4f1a-b977-7c3c5a49a882-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:57:31.498017 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.497935    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp44z\" (UniqueName: \"kubernetes.io/projected/3bc1ca71-4e36-4f1a-b977-7c3c5a49a882-kube-api-access-lp44z\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:57:31.535200 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.535171    2580 generic.go:356] "Generic (PLEG): container finished" podID="53201f42-99e0-4dde-8023-abf9b568fb54" containerID="3eb1c79c8d016889e249a33b67523e94a23e87d659064f22990df7da23a61804" exitCode=0
Jul 27 17:57:31.535320 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.535209    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt" event={"ID":"53201f42-99e0-4dde-8023-abf9b568fb54","Type":"ContainerDied","Data":"3eb1c79c8d016889e249a33b67523e94a23e87d659064f22990df7da23a61804"}
Jul 27 17:57:31.535320 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.535257    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt" event={"ID":"53201f42-99e0-4dde-8023-abf9b568fb54","Type":"ContainerDied","Data":"1b9ff997e84db41e60e1d70f8c28e2ecf84b4b5dd680799386ac13049851f02c"}
Jul 27 17:57:31.535320 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.535217    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"
Jul 27 17:57:31.535320 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.535279    2580 scope.go:117] "RemoveContainer" containerID="3eb1c79c8d016889e249a33b67523e94a23e87d659064f22990df7da23a61804"
Jul 27 17:57:31.536644 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.536616    2580 generic.go:356] "Generic (PLEG): container finished" podID="df284ad0-1e34-4b54-9ff9-ba4716c0c590" containerID="d2b799ed1fd6bf68d92669ca5e0ecef22df9f925bd3a5ba691a179870d0c5394" exitCode=0
Jul 27 17:57:31.536753 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.536702    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"
Jul 27 17:57:31.536814 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.536742    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp" event={"ID":"df284ad0-1e34-4b54-9ff9-ba4716c0c590","Type":"ContainerDied","Data":"d2b799ed1fd6bf68d92669ca5e0ecef22df9f925bd3a5ba691a179870d0c5394"}
Jul 27 17:57:31.536814 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.536797    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp" event={"ID":"df284ad0-1e34-4b54-9ff9-ba4716c0c590","Type":"ContainerDied","Data":"fb34148b8bd8abf2141b300afc7bbe58ddfdedd9fcd6cd909727ec65c36ed816"}
Jul 27 17:57:31.538295 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.538265    2580 generic.go:356] "Generic (PLEG): container finished" podID="3bc1ca71-4e36-4f1a-b977-7c3c5a49a882" containerID="d13140f242a7bc7b48e907cf93e1326d58d7a4cb092c35087123ddb2d050edae" exitCode=0
Jul 27 17:57:31.538393 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.538303    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"
Jul 27 17:57:31.538393 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.538301    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64" event={"ID":"3bc1ca71-4e36-4f1a-b977-7c3c5a49a882","Type":"ContainerDied","Data":"d13140f242a7bc7b48e907cf93e1326d58d7a4cb092c35087123ddb2d050edae"}
Jul 27 17:57:31.538513 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.538424    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64" event={"ID":"3bc1ca71-4e36-4f1a-b977-7c3c5a49a882","Type":"ContainerDied","Data":"fdd4ac7ef945db8835348a46c2c91b138ee64499cf3b05de4496b1057f5227c3"}
Jul 27 17:57:31.545441 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.545422    2580 scope.go:117] "RemoveContainer" containerID="3eb1c79c8d016889e249a33b67523e94a23e87d659064f22990df7da23a61804"
Jul 27 17:57:31.545745 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:57:31.545727    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eb1c79c8d016889e249a33b67523e94a23e87d659064f22990df7da23a61804\": container with ID starting with 3eb1c79c8d016889e249a33b67523e94a23e87d659064f22990df7da23a61804 not found: ID does not exist" containerID="3eb1c79c8d016889e249a33b67523e94a23e87d659064f22990df7da23a61804"
Jul 27 17:57:31.545817 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.545756    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eb1c79c8d016889e249a33b67523e94a23e87d659064f22990df7da23a61804"} err="failed to get container status \"3eb1c79c8d016889e249a33b67523e94a23e87d659064f22990df7da23a61804\": rpc error: code = NotFound desc = could not find container \"3eb1c79c8d016889e249a33b67523e94a23e87d659064f22990df7da23a61804\": container with ID starting with 3eb1c79c8d016889e249a33b67523e94a23e87d659064f22990df7da23a61804 not found: ID does not exist"
Jul 27 17:57:31.545817 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.545775    2580 scope.go:117] "RemoveContainer" containerID="d2b799ed1fd6bf68d92669ca5e0ecef22df9f925bd3a5ba691a179870d0c5394"
Jul 27 17:57:31.553701 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.553683    2580 scope.go:117] "RemoveContainer" containerID="d2b799ed1fd6bf68d92669ca5e0ecef22df9f925bd3a5ba691a179870d0c5394"
Jul 27 17:57:31.553931 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:57:31.553906    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2b799ed1fd6bf68d92669ca5e0ecef22df9f925bd3a5ba691a179870d0c5394\": container with ID starting with d2b799ed1fd6bf68d92669ca5e0ecef22df9f925bd3a5ba691a179870d0c5394 not found: ID does not exist" containerID="d2b799ed1fd6bf68d92669ca5e0ecef22df9f925bd3a5ba691a179870d0c5394"
Jul 27 17:57:31.554008 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.553941    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b799ed1fd6bf68d92669ca5e0ecef22df9f925bd3a5ba691a179870d0c5394"} err="failed to get container status \"d2b799ed1fd6bf68d92669ca5e0ecef22df9f925bd3a5ba691a179870d0c5394\": rpc error: code = NotFound desc = could not find container \"d2b799ed1fd6bf68d92669ca5e0ecef22df9f925bd3a5ba691a179870d0c5394\": container with ID starting with d2b799ed1fd6bf68d92669ca5e0ecef22df9f925bd3a5ba691a179870d0c5394 not found: ID does not exist"
Jul 27 17:57:31.554008 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.553965    2580 scope.go:117] "RemoveContainer" containerID="d13140f242a7bc7b48e907cf93e1326d58d7a4cb092c35087123ddb2d050edae"
Jul 27 17:57:31.558788 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.558768    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"]
Jul 27 17:57:31.561454 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.561438    2580 scope.go:117] "RemoveContainer" containerID="d13140f242a7bc7b48e907cf93e1326d58d7a4cb092c35087123ddb2d050edae"
Jul 27 17:57:31.561710 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:57:31.561689    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d13140f242a7bc7b48e907cf93e1326d58d7a4cb092c35087123ddb2d050edae\": container with ID starting with d13140f242a7bc7b48e907cf93e1326d58d7a4cb092c35087123ddb2d050edae not found: ID does not exist" containerID="d13140f242a7bc7b48e907cf93e1326d58d7a4cb092c35087123ddb2d050edae"
Jul 27 17:57:31.561800 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.561716    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d13140f242a7bc7b48e907cf93e1326d58d7a4cb092c35087123ddb2d050edae"} err="failed to get container status \"d13140f242a7bc7b48e907cf93e1326d58d7a4cb092c35087123ddb2d050edae\": rpc error: code = NotFound desc = could not find container \"d13140f242a7bc7b48e907cf93e1326d58d7a4cb092c35087123ddb2d050edae\": container with ID starting with d13140f242a7bc7b48e907cf93e1326d58d7a4cb092c35087123ddb2d050edae not found: ID does not exist"
Jul 27 17:57:31.565703 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.565684    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-79618e13-d4865f87b-5jn64"]
Jul 27 17:57:31.575778 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.575757    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"]
Jul 27 17:57:31.579809 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.579787    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-79618e13-7fdc7499d-66sbt"]
Jul 27 17:57:31.589345 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.589324    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"]
Jul 27 17:57:31.591318 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:31.591298    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-79618e13-7cf578b47-f4qgp"]
Jul 27 17:57:33.476306 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:33.476271    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bc1ca71-4e36-4f1a-b977-7c3c5a49a882" path="/var/lib/kubelet/pods/3bc1ca71-4e36-4f1a-b977-7c3c5a49a882/volumes"
Jul 27 17:57:33.476692 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:33.476663    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53201f42-99e0-4dde-8023-abf9b568fb54" path="/var/lib/kubelet/pods/53201f42-99e0-4dde-8023-abf9b568fb54/volumes"
Jul 27 17:57:33.477008 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:33.476995    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df284ad0-1e34-4b54-9ff9-ba4716c0c590" path="/var/lib/kubelet/pods/df284ad0-1e34-4b54-9ff9-ba4716c0c590/volumes"
Jul 27 17:57:35.740241 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:35.740210    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"]
Jul 27 17:57:35.740741 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:35.740476    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx" podUID="02bf8f2e-039f-439d-ad1c-3efdd14a7584" containerName="istio-proxy" containerID="cri-o://7938c250970e13c69d3c3ca8a9e01cfe25490e1acc20b987a629f66690401aaa" gracePeriod=30
Jul 27 17:57:40.991220 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:40.991194    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:57:41.077123 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.077036    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istiod-ca-cert\") pod \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") "
Jul 27 17:57:41.077123 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.077075    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-workload-certs\") pod \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") "
Jul 27 17:57:41.077123 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.077092    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-token\") pod \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") "
Jul 27 17:57:41.077123 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.077116    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-data\") pod \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") "
Jul 27 17:57:41.077458 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.077215    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-workload-socket\") pod \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") "
Jul 27 17:57:41.077458 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.077240    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-credential-socket\") pod \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") "
Jul 27 17:57:41.077458 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.077262    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-podinfo\") pod \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") "
Jul 27 17:57:41.077458 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.077287    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-envoy\") pod \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") "
Jul 27 17:57:41.077458 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.077344    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5czbl\" (UniqueName: \"kubernetes.io/projected/02bf8f2e-039f-439d-ad1c-3efdd14a7584-kube-api-access-5czbl\") pod \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\" (UID: \"02bf8f2e-039f-439d-ad1c-3efdd14a7584\") "
Jul 27 17:57:41.077763 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.077518    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "02bf8f2e-039f-439d-ad1c-3efdd14a7584" (UID: "02bf8f2e-039f-439d-ad1c-3efdd14a7584"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:57:41.077763 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.077533    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "02bf8f2e-039f-439d-ad1c-3efdd14a7584" (UID: "02bf8f2e-039f-439d-ad1c-3efdd14a7584"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:57:41.077763 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.077537    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "02bf8f2e-039f-439d-ad1c-3efdd14a7584" (UID: "02bf8f2e-039f-439d-ad1c-3efdd14a7584"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:57:41.077763 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.077690    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "02bf8f2e-039f-439d-ad1c-3efdd14a7584" (UID: "02bf8f2e-039f-439d-ad1c-3efdd14a7584"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:57:41.077763 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.077740    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:57:41.077763 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.077761    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:57:41.078069 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.077774    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:57:41.078302 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.078273    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-data" (OuterVolumeSpecName: "istio-data") pod "02bf8f2e-039f-439d-ad1c-3efdd14a7584" (UID: "02bf8f2e-039f-439d-ad1c-3efdd14a7584"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:57:41.079546 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.079522    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "02bf8f2e-039f-439d-ad1c-3efdd14a7584" (UID: "02bf8f2e-039f-439d-ad1c-3efdd14a7584"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:57:41.079661 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.079622    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "02bf8f2e-039f-439d-ad1c-3efdd14a7584" (UID: "02bf8f2e-039f-439d-ad1c-3efdd14a7584"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 17:57:41.079726 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.079702    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-token" (OuterVolumeSpecName: "istio-token") pod "02bf8f2e-039f-439d-ad1c-3efdd14a7584" (UID: "02bf8f2e-039f-439d-ad1c-3efdd14a7584"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:57:41.079761 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.079737    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02bf8f2e-039f-439d-ad1c-3efdd14a7584-kube-api-access-5czbl" (OuterVolumeSpecName: "kube-api-access-5czbl") pod "02bf8f2e-039f-439d-ad1c-3efdd14a7584" (UID: "02bf8f2e-039f-439d-ad1c-3efdd14a7584"). InnerVolumeSpecName "kube-api-access-5czbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:57:41.178125 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.178094    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:57:41.178125 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.178123    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:57:41.178125 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.178132    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5czbl\" (UniqueName: \"kubernetes.io/projected/02bf8f2e-039f-439d-ad1c-3efdd14a7584-kube-api-access-5czbl\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:57:41.178351 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.178145    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:57:41.178351 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.178159    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:57:41.178351 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.178171    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02bf8f2e-039f-439d-ad1c-3efdd14a7584-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 17:57:41.588747 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.588712    2580 generic.go:356] "Generic (PLEG): container finished" podID="02bf8f2e-039f-439d-ad1c-3efdd14a7584" containerID="7938c250970e13c69d3c3ca8a9e01cfe25490e1acc20b987a629f66690401aaa" exitCode=0
Jul 27 17:57:41.588939 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.588758    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx" event={"ID":"02bf8f2e-039f-439d-ad1c-3efdd14a7584","Type":"ContainerDied","Data":"7938c250970e13c69d3c3ca8a9e01cfe25490e1acc20b987a629f66690401aaa"}
Jul 27 17:57:41.588939 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.588763    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"
Jul 27 17:57:41.588939 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.588800    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx" event={"ID":"02bf8f2e-039f-439d-ad1c-3efdd14a7584","Type":"ContainerDied","Data":"10119623ff88b3403a376855c4e7762b8325c9c76c30f116e4ae805bc786b497"}
Jul 27 17:57:41.588939 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.588823    2580 scope.go:117] "RemoveContainer" containerID="7938c250970e13c69d3c3ca8a9e01cfe25490e1acc20b987a629f66690401aaa"
Jul 27 17:57:41.597569 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.597548    2580 scope.go:117] "RemoveContainer" containerID="fe65b6b7871def7872d458449978d4de66ce7b1fc87eac45f0bdd78606fb1a16"
Jul 27 17:57:41.605042 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.605014    2580 scope.go:117] "RemoveContainer" containerID="7938c250970e13c69d3c3ca8a9e01cfe25490e1acc20b987a629f66690401aaa"
Jul 27 17:57:41.605322 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:57:41.605294    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7938c250970e13c69d3c3ca8a9e01cfe25490e1acc20b987a629f66690401aaa\": container with ID starting with 7938c250970e13c69d3c3ca8a9e01cfe25490e1acc20b987a629f66690401aaa not found: ID does not exist" containerID="7938c250970e13c69d3c3ca8a9e01cfe25490e1acc20b987a629f66690401aaa"
Jul 27 17:57:41.605427 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.605332    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7938c250970e13c69d3c3ca8a9e01cfe25490e1acc20b987a629f66690401aaa"} err="failed to get container status \"7938c250970e13c69d3c3ca8a9e01cfe25490e1acc20b987a629f66690401aaa\": rpc error: code = NotFound desc = could not find container \"7938c250970e13c69d3c3ca8a9e01cfe25490e1acc20b987a629f66690401aaa\": container with ID starting with 7938c250970e13c69d3c3ca8a9e01cfe25490e1acc20b987a629f66690401aaa not found: ID does not exist"
Jul 27 17:57:41.605427 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.605354    2580 scope.go:117] "RemoveContainer" containerID="fe65b6b7871def7872d458449978d4de66ce7b1fc87eac45f0bdd78606fb1a16"
Jul 27 17:57:41.605660 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:57:41.605637    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe65b6b7871def7872d458449978d4de66ce7b1fc87eac45f0bdd78606fb1a16\": container with ID starting with fe65b6b7871def7872d458449978d4de66ce7b1fc87eac45f0bdd78606fb1a16 not found: ID does not exist" containerID="fe65b6b7871def7872d458449978d4de66ce7b1fc87eac45f0bdd78606fb1a16"
Jul 27 17:57:41.605737 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.605672    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe65b6b7871def7872d458449978d4de66ce7b1fc87eac45f0bdd78606fb1a16"} err="failed to get container status \"fe65b6b7871def7872d458449978d4de66ce7b1fc87eac45f0bdd78606fb1a16\": rpc error: code = NotFound desc = could not find container \"fe65b6b7871def7872d458449978d4de66ce7b1fc87eac45f0bdd78606fb1a16\": container with ID starting with fe65b6b7871def7872d458449978d4de66ce7b1fc87eac45f0bdd78606fb1a16 not found: ID does not exist"
Jul 27 17:57:41.607287 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.607262    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"]
Jul 27 17:57:41.609736 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:41.609718    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-79618e13-openshift-default-5c67bc6d68-h2vtx"]
Jul 27 17:57:43.476456 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:57:43.476421    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02bf8f2e-039f-439d-ad1c-3efdd14a7584" path="/var/lib/kubelet/pods/02bf8f2e-039f-439d-ad1c-3efdd14a7584/volumes"
Jul 27 17:59:13.420390 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420296    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"]
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420685    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02bf8f2e-039f-439d-ad1c-3efdd14a7584" containerName="istio-proxy"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420698    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="02bf8f2e-039f-439d-ad1c-3efdd14a7584" containerName="istio-proxy"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420710    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="004fec29-06f7-488c-8050-8f907dfc4fd9" containerName="istio-proxy"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420715    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="004fec29-06f7-488c-8050-8f907dfc4fd9" containerName="istio-proxy"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420725    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc1ca71-4e36-4f1a-b977-7c3c5a49a882" containerName="payload-pre-processing"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420732    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc1ca71-4e36-4f1a-b977-7c3c5a49a882" containerName="payload-pre-processing"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420744    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="004fec29-06f7-488c-8050-8f907dfc4fd9" containerName="istio-proxy"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420750    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="004fec29-06f7-488c-8050-8f907dfc4fd9" containerName="istio-proxy"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420762    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53201f42-99e0-4dde-8023-abf9b568fb54" containerName="payload-processing"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420768    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="53201f42-99e0-4dde-8023-abf9b568fb54" containerName="payload-processing"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420774    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df284ad0-1e34-4b54-9ff9-ba4716c0c590" containerName="maas-api"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420780    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="df284ad0-1e34-4b54-9ff9-ba4716c0c590" containerName="maas-api"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420830    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="53201f42-99e0-4dde-8023-abf9b568fb54" containerName="payload-processing"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420839    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="02bf8f2e-039f-439d-ad1c-3efdd14a7584" containerName="istio-proxy"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420844    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="df284ad0-1e34-4b54-9ff9-ba4716c0c590" containerName="maas-api"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420851    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="02bf8f2e-039f-439d-ad1c-3efdd14a7584" containerName="istio-proxy"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420857    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bc1ca71-4e36-4f1a-b977-7c3c5a49a882" containerName="payload-pre-processing"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420863    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="004fec29-06f7-488c-8050-8f907dfc4fd9" containerName="istio-proxy"
Jul 27 17:59:13.420992 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.420868    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="004fec29-06f7-488c-8050-8f907dfc4fd9" containerName="istio-proxy"
Jul 27 17:59:13.423943 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.423925    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.426699 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.426677    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ea7cbb1a-openshift-default-dockercfg-wf9v2\""
Jul 27 17:59:13.443414 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.443390    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"]
Jul 27 17:59:13.535100 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.535061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-credential-socket\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.535100 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.535110    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl892\" (UniqueName: \"kubernetes.io/projected/faf63eac-cc01-4492-a13c-16ea05f0a9eb-kube-api-access-tl892\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.535461 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.535226    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-podinfo\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.535461 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.535294    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-envoy\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.535461 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.535386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-workload-socket\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.535461 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.535431    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-token\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.535673 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.535467    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istiod-ca-cert\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.535673 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.535492    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-workload-certs\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.535673 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.535516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-data\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.636511 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.636475    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-credential-socket\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.636511 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.636510    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl892\" (UniqueName: \"kubernetes.io/projected/faf63eac-cc01-4492-a13c-16ea05f0a9eb-kube-api-access-tl892\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.636755 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.636539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-podinfo\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.636755 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.636573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-envoy\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.636755 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.636660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-workload-socket\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.636755 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.636694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-token\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.636755 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.636727    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istiod-ca-cert\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.636755 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.636752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-workload-certs\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.637068 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.636775    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-data\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.637068 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.636925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-credential-socket\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.637167 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.637095    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-workload-socket\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.637167 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.637135    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-workload-certs\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.637253 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.637163    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-data\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.637511 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.637492    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istiod-ca-cert\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.639364 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.639340    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-envoy\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.639712 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.639679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-podinfo\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.648712 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.648685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-token\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.648838 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.648774    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl892\" (UniqueName: \"kubernetes.io/projected/faf63eac-cc01-4492-a13c-16ea05f0a9eb-kube-api-access-tl892\") pod \"e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") " pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.733911 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.733835    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:13.887300 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.887276    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"]
Jul 27 17:59:13.889491 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:59:13.889465    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf63eac_cc01_4492_a13c_16ea05f0a9eb.slice/crio-9254a9b6ef07a9d5c28c0ca287cf75430705261df5b412fd5ee278104a5dd5ea WatchSource:0}: Error finding container 9254a9b6ef07a9d5c28c0ca287cf75430705261df5b412fd5ee278104a5dd5ea: Status 404 returned error can't find the container with id 9254a9b6ef07a9d5c28c0ca287cf75430705261df5b412fd5ee278104a5dd5ea
Jul 27 17:59:13.891662 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.891618    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:59:13.891749 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.891694    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:59:13.891749 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:13.891725    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:59:14.030317 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:14.030228    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m" event={"ID":"faf63eac-cc01-4492-a13c-16ea05f0a9eb","Type":"ContainerStarted","Data":"f2c25f4b8970ae2605433a47fc7ce14b2eecfcd46c6f6c84c9062e602177f9dc"}
Jul 27 17:59:14.030317 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:14.030301    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m" event={"ID":"faf63eac-cc01-4492-a13c-16ea05f0a9eb","Type":"ContainerStarted","Data":"9254a9b6ef07a9d5c28c0ca287cf75430705261df5b412fd5ee278104a5dd5ea"}
Jul 27 17:59:14.056418 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:14.056365    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m" podStartSLOduration=1.056349368 podStartE2EDuration="1.056349368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:59:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:59:14.054565175 +0000 UTC m=+2097.069231618" watchObservedRunningTime="2026-07-27 17:59:14.056349368 +0000 UTC m=+2097.071015811"
Jul 27 17:59:14.734061 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:14.734020    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:14.738332 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:14.738306    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:15.035846 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:15.035764    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:15.036770 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:15.036746    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:16.394486 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:16.394446    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"]
Jul 27 17:59:16.395043 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:16.395022    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02bf8f2e-039f-439d-ad1c-3efdd14a7584" containerName="istio-proxy"
Jul 27 17:59:16.395123 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:16.395045    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="02bf8f2e-039f-439d-ad1c-3efdd14a7584" containerName="istio-proxy"
Jul 27 17:59:16.398204 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:16.398184    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"
Jul 27 17:59:16.401938 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:16.401914    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ea7cbb1a-serving-cert\""
Jul 27 17:59:16.413318 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:16.413299    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"]
Jul 27 17:59:16.462774 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:16.462738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6tzk\" (UniqueName: \"kubernetes.io/projected/d605e0b9-3e1d-40ec-ba30-927a1942baf7-kube-api-access-p6tzk\") pod \"maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777\" (UID: \"d605e0b9-3e1d-40ec-ba30-927a1942baf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"
Jul 27 17:59:16.462924 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:16.462793    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d605e0b9-3e1d-40ec-ba30-927a1942baf7-maas-api-tls\") pod \"maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777\" (UID: \"d605e0b9-3e1d-40ec-ba30-927a1942baf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"
Jul 27 17:59:16.462924 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:16.462839    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d605e0b9-3e1d-40ec-ba30-927a1942baf7-openshift-service-ca\") pod \"maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777\" (UID: \"d605e0b9-3e1d-40ec-ba30-927a1942baf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"
Jul 27 17:59:16.563339 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:16.563308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d605e0b9-3e1d-40ec-ba30-927a1942baf7-maas-api-tls\") pod \"maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777\" (UID: \"d605e0b9-3e1d-40ec-ba30-927a1942baf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"
Jul 27 17:59:16.563530 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:16.563350    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d605e0b9-3e1d-40ec-ba30-927a1942baf7-openshift-service-ca\") pod \"maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777\" (UID: \"d605e0b9-3e1d-40ec-ba30-927a1942baf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"
Jul 27 17:59:16.563530 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:16.563426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6tzk\" (UniqueName: \"kubernetes.io/projected/d605e0b9-3e1d-40ec-ba30-927a1942baf7-kube-api-access-p6tzk\") pod \"maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777\" (UID: \"d605e0b9-3e1d-40ec-ba30-927a1942baf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"
Jul 27 17:59:16.563530 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:59:16.563468    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-serving-cert: secret "maas-api-e2e-mt-ea7cbb1a-serving-cert" not found
Jul 27 17:59:16.563530 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:59:16.563532    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d605e0b9-3e1d-40ec-ba30-927a1942baf7-maas-api-tls podName:d605e0b9-3e1d-40ec-ba30-927a1942baf7 nodeName:}" failed. No retries permitted until 2026-07-27 17:59:17.063511826 +0000 UTC m=+2100.078178261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d605e0b9-3e1d-40ec-ba30-927a1942baf7-maas-api-tls") pod "maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777" (UID: "d605e0b9-3e1d-40ec-ba30-927a1942baf7") : secret "maas-api-e2e-mt-ea7cbb1a-serving-cert" not found
Jul 27 17:59:16.564121 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:16.564098    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d605e0b9-3e1d-40ec-ba30-927a1942baf7-openshift-service-ca\") pod \"maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777\" (UID: \"d605e0b9-3e1d-40ec-ba30-927a1942baf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"
Jul 27 17:59:16.572774 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:16.572750    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6tzk\" (UniqueName: \"kubernetes.io/projected/d605e0b9-3e1d-40ec-ba30-927a1942baf7-kube-api-access-p6tzk\") pod \"maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777\" (UID: \"d605e0b9-3e1d-40ec-ba30-927a1942baf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"
Jul 27 17:59:17.035854 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.035819    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"]
Jul 27 17:59:17.039562 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.039545    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"
Jul 27 17:59:17.043090 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.043063    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-ea7cbb1a\""
Jul 27 17:59:17.043413 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.043393    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-ea7cbb1a-dockercfg-z769t\""
Jul 27 17:59:17.056736 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.056714    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"]
Jul 27 17:59:17.068075 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.068046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d605e0b9-3e1d-40ec-ba30-927a1942baf7-maas-api-tls\") pod \"maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777\" (UID: \"d605e0b9-3e1d-40ec-ba30-927a1942baf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"
Jul 27 17:59:17.070525 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.070500    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d605e0b9-3e1d-40ec-ba30-927a1942baf7-maas-api-tls\") pod \"maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777\" (UID: \"d605e0b9-3e1d-40ec-ba30-927a1942baf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"
Jul 27 17:59:17.087466 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.087423    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"]
Jul 27 17:59:17.094809 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.094788    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"
Jul 27 17:59:17.102885 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.102861    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"]
Jul 27 17:59:17.168728 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.168687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf347cca-07c1-4605-89bd-c8e8435883fc-plugins-config-volume\") pod \"payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4\" (UID: \"cf347cca-07c1-4605-89bd-c8e8435883fc\") " pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"
Jul 27 17:59:17.168907 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.168829    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d106bdd6-15e6-401a-92a9-6e8d0743771f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn\" (UID: \"d106bdd6-15e6-401a-92a9-6e8d0743771f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"
Jul 27 17:59:17.168907 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.168854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb5mt\" (UniqueName: \"kubernetes.io/projected/cf347cca-07c1-4605-89bd-c8e8435883fc-kube-api-access-mb5mt\") pod \"payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4\" (UID: \"cf347cca-07c1-4605-89bd-c8e8435883fc\") " pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"
Jul 27 17:59:17.169055 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.169031    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7wtn\" (UniqueName: \"kubernetes.io/projected/d106bdd6-15e6-401a-92a9-6e8d0743771f-kube-api-access-j7wtn\") pod \"payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn\" (UID: \"d106bdd6-15e6-401a-92a9-6e8d0743771f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"
Jul 27 17:59:17.269837 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.269801    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf347cca-07c1-4605-89bd-c8e8435883fc-plugins-config-volume\") pod \"payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4\" (UID: \"cf347cca-07c1-4605-89bd-c8e8435883fc\") " pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"
Jul 27 17:59:17.269837 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.269847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d106bdd6-15e6-401a-92a9-6e8d0743771f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn\" (UID: \"d106bdd6-15e6-401a-92a9-6e8d0743771f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"
Jul 27 17:59:17.270102 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.269872    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb5mt\" (UniqueName: \"kubernetes.io/projected/cf347cca-07c1-4605-89bd-c8e8435883fc-kube-api-access-mb5mt\") pod \"payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4\" (UID: \"cf347cca-07c1-4605-89bd-c8e8435883fc\") " pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"
Jul 27 17:59:17.270102 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.269949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7wtn\" (UniqueName: \"kubernetes.io/projected/d106bdd6-15e6-401a-92a9-6e8d0743771f-kube-api-access-j7wtn\") pod \"payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn\" (UID: \"d106bdd6-15e6-401a-92a9-6e8d0743771f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"
Jul 27 17:59:17.270541 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.270517    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf347cca-07c1-4605-89bd-c8e8435883fc-plugins-config-volume\") pod \"payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4\" (UID: \"cf347cca-07c1-4605-89bd-c8e8435883fc\") " pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"
Jul 27 17:59:17.270636 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.270544    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d106bdd6-15e6-401a-92a9-6e8d0743771f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn\" (UID: \"d106bdd6-15e6-401a-92a9-6e8d0743771f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"
Jul 27 17:59:17.281498 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.281462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb5mt\" (UniqueName: \"kubernetes.io/projected/cf347cca-07c1-4605-89bd-c8e8435883fc-kube-api-access-mb5mt\") pod \"payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4\" (UID: \"cf347cca-07c1-4605-89bd-c8e8435883fc\") " pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"
Jul 27 17:59:17.281749 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.281729    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7wtn\" (UniqueName: \"kubernetes.io/projected/d106bdd6-15e6-401a-92a9-6e8d0743771f-kube-api-access-j7wtn\") pod \"payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn\" (UID: \"d106bdd6-15e6-401a-92a9-6e8d0743771f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"
Jul 27 17:59:17.308540 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.308479    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"
Jul 27 17:59:17.351820 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.351785    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"
Jul 27 17:59:17.405937 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.405875    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"
Jul 27 17:59:17.521078 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.521052    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"]
Jul 27 17:59:17.523898 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:59:17.523863    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf347cca_07c1_4605_89bd_c8e8435883fc.slice/crio-00bcb7bc551cccdd727a4aac08c5eea361b762c775eb70491825204f53b4ff65 WatchSource:0}: Error finding container 00bcb7bc551cccdd727a4aac08c5eea361b762c775eb70491825204f53b4ff65: Status 404 returned error can't find the container with id 00bcb7bc551cccdd727a4aac08c5eea361b762c775eb70491825204f53b4ff65
Jul 27 17:59:17.667927 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.667821    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"]
Jul 27 17:59:17.670217 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:59:17.670184    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd605e0b9_3e1d_40ec_ba30_927a1942baf7.slice/crio-e08b38442a1a5e1fc837d093554167f85010cdcc303f83e57e68040f2385b3c9 WatchSource:0}: Error finding container e08b38442a1a5e1fc837d093554167f85010cdcc303f83e57e68040f2385b3c9: Status 404 returned error can't find the container with id e08b38442a1a5e1fc837d093554167f85010cdcc303f83e57e68040f2385b3c9
Jul 27 17:59:17.799635 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:17.799610    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"]
Jul 27 17:59:17.801835 ip-10-0-131-200 kubenswrapper[2580]: W0727 17:59:17.801803    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd106bdd6_15e6_401a_92a9_6e8d0743771f.slice/crio-3d54438cfddf60562176698c261494bd598b6b0409b3279e6d0a87fe91af3a0b WatchSource:0}: Error finding container 3d54438cfddf60562176698c261494bd598b6b0409b3279e6d0a87fe91af3a0b: Status 404 returned error can't find the container with id 3d54438cfddf60562176698c261494bd598b6b0409b3279e6d0a87fe91af3a0b
Jul 27 17:59:18.053474 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:18.053422    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn" event={"ID":"d106bdd6-15e6-401a-92a9-6e8d0743771f","Type":"ContainerStarted","Data":"03e413667c24a468190262456cb84c5aeb9d306e21a666c46a0ff4536b5b4522"}
Jul 27 17:59:18.053695 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:18.053501    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn" event={"ID":"d106bdd6-15e6-401a-92a9-6e8d0743771f","Type":"ContainerStarted","Data":"3d54438cfddf60562176698c261494bd598b6b0409b3279e6d0a87fe91af3a0b"}
Jul 27 17:59:18.053695 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:18.053627    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"
Jul 27 17:59:18.055041 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:18.055012    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4" event={"ID":"cf347cca-07c1-4605-89bd-c8e8435883fc","Type":"ContainerStarted","Data":"882eed72747746ca0abe36b80580794f92bae29830d23f19bbc7d4f52928c916"}
Jul 27 17:59:18.055166 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:18.055063    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4" event={"ID":"cf347cca-07c1-4605-89bd-c8e8435883fc","Type":"ContainerStarted","Data":"00bcb7bc551cccdd727a4aac08c5eea361b762c775eb70491825204f53b4ff65"}
Jul 27 17:59:18.055166 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:18.055091    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"
Jul 27 17:59:18.056406 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:18.056384    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777" event={"ID":"d605e0b9-3e1d-40ec-ba30-927a1942baf7","Type":"ContainerStarted","Data":"e08b38442a1a5e1fc837d093554167f85010cdcc303f83e57e68040f2385b3c9"}
Jul 27 17:59:18.071643 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:18.071533    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn" podStartSLOduration=1.071519765 podStartE2EDuration="1.071519765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:59:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:59:18.070530697 +0000 UTC m=+2101.085197147" watchObservedRunningTime="2026-07-27 17:59:18.071519765 +0000 UTC m=+2101.086186209"
Jul 27 17:59:18.087258 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:18.087217    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4" podStartSLOduration=1.087204205 podStartE2EDuration="1.087204205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:59:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:59:18.086427112 +0000 UTC m=+2101.101093556" watchObservedRunningTime="2026-07-27 17:59:18.087204205 +0000 UTC m=+2101.101870649"
Jul 27 17:59:20.067688 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:20.067642    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777" event={"ID":"d605e0b9-3e1d-40ec-ba30-927a1942baf7","Type":"ContainerStarted","Data":"bc05f130b37bf2f8bd014eed68a53399c137f98838decba9024ee715de52c21b"}
Jul 27 17:59:20.068072 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:20.067762    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"
Jul 27 17:59:20.087886 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:20.087835    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777" podStartSLOduration=2.588991525 podStartE2EDuration="4.087820099s" totalImagesPullingTime="1.498828574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:59:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:59:20.086405698 +0000 UTC m=+2103.101072153" watchObservedRunningTime="2026-07-27 17:59:20.087820099 +0000 UTC m=+2103.102486543"
Jul 27 17:59:26.078112 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:26.078079    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"
Jul 27 17:59:29.063635 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:29.063600    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"
Jul 27 17:59:29.064057 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:29.063684    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"
Jul 27 17:59:29.112645 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:29.112542    2580 generic.go:356] "Generic (PLEG): container finished" podID="faf63eac-cc01-4492-a13c-16ea05f0a9eb" containerID="f2c25f4b8970ae2605433a47fc7ce14b2eecfcd46c6f6c84c9062e602177f9dc" exitCode=0
Jul 27 17:59:29.112645 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:29.112610    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m" event={"ID":"faf63eac-cc01-4492-a13c-16ea05f0a9eb","Type":"ContainerDied","Data":"f2c25f4b8970ae2605433a47fc7ce14b2eecfcd46c6f6c84c9062e602177f9dc"}
Jul 27 17:59:29.113070 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:29.113046    2580 scope.go:117] "RemoveContainer" containerID="f2c25f4b8970ae2605433a47fc7ce14b2eecfcd46c6f6c84c9062e602177f9dc"
Jul 27 17:59:29.114265 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:29.114232    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:59:29.114407 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:29.114313    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:59:29.114407 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:29.114362    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 17:59:30.035693 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:30.035658    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:30.119264 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:30.119228    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m" event={"ID":"faf63eac-cc01-4492-a13c-16ea05f0a9eb","Type":"ContainerStarted","Data":"86e08b3ee1a2f624ce74c41badc7e091a107260afecfefde1e04950d79ca1d96"}
Jul 27 17:59:30.734670 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:30.734629    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:30.735681 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:30.735658    2580 patch_prober.go:28] interesting pod/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 27 17:59:30.735768 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:30.735719    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m" podUID="faf63eac-cc01-4492-a13c-16ea05f0a9eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 27 17:59:31.734497 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:31.734460    2580 patch_prober.go:28] interesting pod/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 27 17:59:31.734914 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:31.734514    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m" podUID="faf63eac-cc01-4492-a13c-16ea05f0a9eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 27 17:59:32.734222 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:32.734185    2580 patch_prober.go:28] interesting pod/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 27 17:59:32.734411 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:32.734246    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m" podUID="faf63eac-cc01-4492-a13c-16ea05f0a9eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 27 17:59:33.734893 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:33.734856    2580 patch_prober.go:28] interesting pod/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 27 17:59:33.735295 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:33.734915    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m" podUID="faf63eac-cc01-4492-a13c-16ea05f0a9eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 27 17:59:34.737828 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:34.737795    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:34.738202 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:34.738172    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:34.738919 ip-10-0-131-200 kubenswrapper[2580]: I0727 17:59:34.738902    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 17:59:49.835364 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:59:49.835316    2580 controller.go:195] "Failed to update lease" err="Put \"https://a75a3c80252074770a012f5ffb490bad-b87c2432e58db825.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-131-200.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 27 17:59:59.835952 ip-10-0-131-200 kubenswrapper[2580]: E0727 17:59:59.835904    2580 controller.go:195] "Failed to update lease" err="Put \"https://a75a3c80252074770a012f5ffb490bad-b87c2432e58db825.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-131-200.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 27 18:00:01.369027 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:00:01.368972    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T17:59:51Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T17:59:51Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T17:59:51Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T17:59:51Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-131-200.ec2.internal\": Patch \"https://a75a3c80252074770a012f5ffb490bad-b87c2432e58db825.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-131-200.ec2.internal/status?timeout=10s\": context deadline exceeded"
Jul 27 18:00:09.836621 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:00:09.836511    2580 controller.go:195] "Failed to update lease" err="Put \"https://a75a3c80252074770a012f5ffb490bad-b87c2432e58db825.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-131-200.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 27 18:00:11.370152 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:00:11.370113    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-200.ec2.internal\": Get \"https://a75a3c80252074770a012f5ffb490bad-b87c2432e58db825.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-131-200.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 27 18:00:17.747105 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747061    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747105 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747061    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747105 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747068    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747105 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747077    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747129    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747136    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"default-dockercfg-khxw9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747147    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747160    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-ea7cbb1a-dockercfg-z769t\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747173    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-dockercfg-6jhmf\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747193    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747226    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747245    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-krhhm\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747258    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747257    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sgjmp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:00:17.747253    2580 controller.go:195] "Failed to update lease" err="Put \"https://a75a3c80252074770a012f5ffb490bad-b87c2432e58db825.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-131-200.ec2.internal?timeout=10s\": http2: client connection lost"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747274    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747294    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bxttk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747316    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747326    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747319    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747334    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jcmcw\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.747791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747349    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-sm5z8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747379    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747394    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747405    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747409    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fzmhg\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747435    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b9sxj\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747447    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"original-pull-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747455    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747468    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-g26nl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747494    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747498    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mgql4\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747514    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747516    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747532    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fs5dv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747548    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747561    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747561    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747617    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.748650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747629    2580 reflector.go:571] "Warning: watch ended with error" reflector="pkg/kubelet/config/apiserver.go:66" type="*v1.Pod" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747634    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gk66w\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747644    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747652    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747659    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rkvgp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747664    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747680    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7b6d9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747686    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747688    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-kx767\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747700    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747729    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-p26dr\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747730    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747742    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747759    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747766    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747770    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747701    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747784    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hrwf2\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749254 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747745    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747796    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747799    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747733    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747821    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747830    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-86l6p\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747836    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wz2lb\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747854    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747853    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2rvkz\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747863    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wkb8l\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747766    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747872    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747899    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747905    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c6csp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747900    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747917    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"default-dockercfg-9j9hw\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747925    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747939    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.749856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747943    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747952    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747965    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747968    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-g82df\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747873    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747903    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747986    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vcrzv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747955    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748006    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d4fgj\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748010    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z8v8w\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748008    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-agent\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748036    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748036    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-m4jxf\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.747997    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-p7t7b\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748056    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748064    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748060    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748085    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.750402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748085    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748122    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748135    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:00:17.748071    2580 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a75a3c80252074770a012f5ffb490bad-b87c2432e58db825.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-ingress/events/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m.18c6375c098c452e\": http2: client connection lost" event=<
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]:         &Event{ObjectMeta:{e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m.18c6375c098c452e  openshift-ingress   48866 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-ingress,Name:e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m,UID:faf63eac-cc01-4492-a13c-16ea05f0a9eb,APIVersion:v1,ResourceVersion:48143,FieldPath:spec.containers{istio-proxy},},Reason:ProbeError,Message:Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]:         body:
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]:         ,Source:EventSource{Component:kubelet,Host:ip-10-0-131-200.ec2.internal,},FirstTimestamp:2026-07-27 17:59:30 +0000 UTC,LastTimestamp:2026-07-27 17:59:33.734891106 +0000 UTC m=+2116.749557541,Count:4,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-200.ec2.internal,}
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]:  >
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748145    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6qpqw\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748156    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748161    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ea7cbb1a-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748172    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748179    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748183    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748194    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748196    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748205    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-ea7cbb1a\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748139    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748220    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-ttjbz\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748212    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748229    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qppjx\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748155    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748234    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748250    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748245    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-695n9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748258    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748251    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"default-dockercfg-js8m8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748269    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748274    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748280    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748233    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748290    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748290    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pwzz8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748302    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748309    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"e2e-mt-ea7cbb1a-openshift-default-dockercfg-wf9v2\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748165    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748304    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.751631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748326    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.752174 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748279    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.752174 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748301    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.752174 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748205    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:17.752174 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:17.748335    2580 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 27 18:00:18.556278 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.556246    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ea7cbb1a-serving-cert\""
Jul 27 18:00:18.557560 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.557527    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 27 18:00:18.576204 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.576179    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 18:00:18.583591 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.583567    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:00:18.585209 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.585193    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 18:00:18.587707 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.587690    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 18:00:18.590725 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.590709    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 27 18:00:18.601008 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.600991    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 18:00:18.601630 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.601616    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 18:00:18.615235 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.615214    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 27 18:00:18.625209 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.625194    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-ttjbz\""
Jul 27 18:00:18.634132 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.634115    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hrwf2\""
Jul 27 18:00:18.635934 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.635918    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 18:00:18.636920 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.636907    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:00:18.669903 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.669868    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 18:00:18.671595 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.671565    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d4fgj\""
Jul 27 18:00:18.673061 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.673047    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-86l6p\""
Jul 27 18:00:18.674296 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.674275    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 18:00:18.679620 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.679602    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 27 18:00:18.682169 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.682155    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 18:00:18.688568 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.688555    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mgql4\""
Jul 27 18:00:18.692877 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.692863    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 18:00:18.693164 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.693147    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 18:00:18.695806 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.695782    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 18:00:18.700967 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.700950    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 27 18:00:18.703517 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.703502    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 18:00:18.707601 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.707574    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-khxw9\""
Jul 27 18:00:18.711600 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.711573    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 18:00:18.731459 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.731443    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 18:00:18.737171 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.737154    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 18:00:18.737253 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.737238    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sgjmp\""
Jul 27 18:00:18.739675 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.739661    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 18:00:18.742405 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.742386    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 18:00:18.743747 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.743732    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 18:00:18.752807 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.752787    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 27 18:00:18.757016 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.757002    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 18:00:18.758014 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.758000    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 27 18:00:18.777680 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.777659    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 18:00:18.779245 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.779232    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 18:00:18.780380 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.780366    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 18:00:18.780946 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.780930    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jcmcw\""
Jul 27 18:00:18.782066 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.782052    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-kx767\""
Jul 27 18:00:18.782668 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.782657    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 18:00:18.798268 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.798249    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z8v8w\""
Jul 27 18:00:18.805808 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.805792    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wkb8l\""
Jul 27 18:00:18.807258 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.807217    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-krhhm\""
Jul 27 18:00:18.812535 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.812508    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:00:18.820872 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.820851    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 18:00:18.833763 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.833743    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 18:00:18.842062 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.842043    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-js8m8\""
Jul 27 18:00:18.849226 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.849207    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 27 18:00:18.855840 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.855819    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 18:00:18.858508 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.858494    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 18:00:18.861119 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.861104    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 18:00:18.872510 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.872495    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wz2lb\""
Jul 27 18:00:18.878650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.878631    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 18:00:18.883859 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.883845    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 18:00:18.883917 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.883846    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-m4jxf\""
Jul 27 18:00:18.884674 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.884657    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 27 18:00:18.888521 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.888506    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 18:00:18.894590 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.894557    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 27 18:00:18.896211 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.896197    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9j9hw\""
Jul 27 18:00:18.906022 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.905996    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 27 18:00:18.907641 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.907624    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 18:00:18.908684 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.908670    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b9sxj\""
Jul 27 18:00:18.914263 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.914248    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2rvkz\""
Jul 27 18:00:18.915755 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.915742    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 27 18:00:18.922964 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.922940    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 18:00:18.929713 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.929696    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 18:00:18.937555 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.937534    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 18:00:18.943074 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.943058    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c6csp\""
Jul 27 18:00:18.948411 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.948395    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 18:00:18.949477 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.949464    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 18:00:18.991641 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.991621    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 18:00:18.991752 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.991701    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:00:18.994768 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:18.994749    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 18:00:19.009792 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.009771    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-695n9\""
Jul 27 18:00:19.019393 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.019371    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 18:00:19.033219 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.033201    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 18:00:19.053913 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.053886    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-p26dr\""
Jul 27 18:00:19.071261 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.071200    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 18:00:19.071261 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.071215    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gk66w\""
Jul 27 18:00:19.075417 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.075400    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-p7t7b\""
Jul 27 18:00:19.087114 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.087094    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 18:00:19.087296 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.087281    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 18:00:19.090031 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.090015    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 18:00:19.096763 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.096746    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 18:00:19.101166 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.101151    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pwzz8\""
Jul 27 18:00:19.108424 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.108409    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 27 18:00:19.114554 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.114538    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 27 18:00:19.124058 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.124041    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 18:00:19.126978 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.126962    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vcrzv\""
Jul 27 18:00:19.160401 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.160381    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 18:00:19.162913 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.162899    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7b6d9\""
Jul 27 18:00:19.174080 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.174063    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 18:00:19.175751 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.175736    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-sm5z8\""
Jul 27 18:00:19.177011 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.176994    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bxttk\""
Jul 27 18:00:19.179722 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.179708    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:00:19.183512 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.183499    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 18:00:19.193255 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.193237    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 18:00:19.202402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.202388    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6jhmf\""
Jul 27 18:00:19.208357 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.208342    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 18:00:19.217843 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.217825    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:00:19.218544 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.218530    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 27 18:00:19.224780 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.224766    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-g26nl\""
Jul 27 18:00:19.232209 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.232187    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 18:00:19.242597 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.242566    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ea7cbb1a-openshift-default-dockercfg-wf9v2\""
Jul 27 18:00:19.247227 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.247208    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6qpqw\""
Jul 27 18:00:19.255400 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.255379    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rkvgp\""
Jul 27 18:00:19.269536 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.269517    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 27 18:00:19.270700 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.270684    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 18:00:19.273453 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.273434    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m","odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777","openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn","openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"]
Jul 27 18:00:19.273758 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.273741    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fzmhg\""
Jul 27 18:00:19.273806 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.273749    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m" podUID="faf63eac-cc01-4492-a13c-16ea05f0a9eb" containerName="istio-proxy" containerID="cri-o://86e08b3ee1a2f624ce74c41badc7e091a107260afecfefde1e04950d79ca1d96" gracePeriod=30
Jul 27 18:00:19.273857 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.273802    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn" podUID="d106bdd6-15e6-401a-92a9-6e8d0743771f" containerName="payload-pre-processing" containerID="cri-o://03e413667c24a468190262456cb84c5aeb9d306e21a666c46a0ff4536b5b4522" gracePeriod=30
Jul 27 18:00:19.273917 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.273836    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777" podUID="d605e0b9-3e1d-40ec-ba30-927a1942baf7" containerName="maas-api" containerID="cri-o://bc05f130b37bf2f8bd014eed68a53399c137f98838decba9024ee715de52c21b" gracePeriod=30
Jul 27 18:00:19.273999 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.273951    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4" podUID="cf347cca-07c1-4605-89bd-c8e8435883fc" containerName="payload-processing" containerID="cri-o://882eed72747746ca0abe36b80580794f92bae29830d23f19bbc7d4f52928c916" gracePeriod=30
Jul 27 18:00:19.278245 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.277931    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 18:00:19.286153 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.286128    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 18:00:19.290856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.290827    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qppjx\""
Jul 27 18:00:19.298183 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.298165    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-g82df\""
Jul 27 18:00:19.298282 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.298220    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 18:00:19.300483 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.300465    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 18:00:19.303010 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.302993    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fs5dv\""
Jul 27 18:00:19.304159 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.304141    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:00:19.304740 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.304727    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 18:00:19.309363 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.309342    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 18:00:19.317803 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.317788    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-ea7cbb1a\""
Jul 27 18:00:19.319240 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.319225    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-ea7cbb1a-dockercfg-z769t\""
Jul 27 18:00:19.330439 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.330392    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 18:00:19.339235 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.339215    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 18:00:19.340025 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.340008    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 27 18:00:19.355921 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.355904    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 18:00:19.376475 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.376456    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 18:00:19.564229 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.564204    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"
Jul 27 18:00:19.594839 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.594816    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"
Jul 27 18:00:19.597812 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.597795    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"
Jul 27 18:00:19.719795 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.719760    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6tzk\" (UniqueName: \"kubernetes.io/projected/d605e0b9-3e1d-40ec-ba30-927a1942baf7-kube-api-access-p6tzk\") pod \"d605e0b9-3e1d-40ec-ba30-927a1942baf7\" (UID: \"d605e0b9-3e1d-40ec-ba30-927a1942baf7\") "
Jul 27 18:00:19.719968 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.719854    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf347cca-07c1-4605-89bd-c8e8435883fc-plugins-config-volume\") pod \"cf347cca-07c1-4605-89bd-c8e8435883fc\" (UID: \"cf347cca-07c1-4605-89bd-c8e8435883fc\") "
Jul 27 18:00:19.719968 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.719881    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb5mt\" (UniqueName: \"kubernetes.io/projected/cf347cca-07c1-4605-89bd-c8e8435883fc-kube-api-access-mb5mt\") pod \"cf347cca-07c1-4605-89bd-c8e8435883fc\" (UID: \"cf347cca-07c1-4605-89bd-c8e8435883fc\") "
Jul 27 18:00:19.719968 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.719921    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d106bdd6-15e6-401a-92a9-6e8d0743771f-plugins-config-volume\") pod \"d106bdd6-15e6-401a-92a9-6e8d0743771f\" (UID: \"d106bdd6-15e6-401a-92a9-6e8d0743771f\") "
Jul 27 18:00:19.720086 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.719972    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7wtn\" (UniqueName: \"kubernetes.io/projected/d106bdd6-15e6-401a-92a9-6e8d0743771f-kube-api-access-j7wtn\") pod \"d106bdd6-15e6-401a-92a9-6e8d0743771f\" (UID: \"d106bdd6-15e6-401a-92a9-6e8d0743771f\") "
Jul 27 18:00:19.720086 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.720022    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d605e0b9-3e1d-40ec-ba30-927a1942baf7-maas-api-tls\") pod \"d605e0b9-3e1d-40ec-ba30-927a1942baf7\" (UID: \"d605e0b9-3e1d-40ec-ba30-927a1942baf7\") "
Jul 27 18:00:19.720086 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.720067    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d605e0b9-3e1d-40ec-ba30-927a1942baf7-openshift-service-ca\") pod \"d605e0b9-3e1d-40ec-ba30-927a1942baf7\" (UID: \"d605e0b9-3e1d-40ec-ba30-927a1942baf7\") "
Jul 27 18:00:19.720350 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.720301    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf347cca-07c1-4605-89bd-c8e8435883fc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cf347cca-07c1-4605-89bd-c8e8435883fc" (UID: "cf347cca-07c1-4605-89bd-c8e8435883fc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:00:19.720350 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.720340    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d106bdd6-15e6-401a-92a9-6e8d0743771f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d106bdd6-15e6-401a-92a9-6e8d0743771f" (UID: "d106bdd6-15e6-401a-92a9-6e8d0743771f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:00:19.720526 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.720415    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf347cca-07c1-4605-89bd-c8e8435883fc-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:00:19.720706 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.720676    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d605e0b9-3e1d-40ec-ba30-927a1942baf7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d605e0b9-3e1d-40ec-ba30-927a1942baf7" (UID: "d605e0b9-3e1d-40ec-ba30-927a1942baf7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:00:19.722201 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.722177    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d106bdd6-15e6-401a-92a9-6e8d0743771f-kube-api-access-j7wtn" (OuterVolumeSpecName: "kube-api-access-j7wtn") pod "d106bdd6-15e6-401a-92a9-6e8d0743771f" (UID: "d106bdd6-15e6-401a-92a9-6e8d0743771f"). InnerVolumeSpecName "kube-api-access-j7wtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:00:19.722201 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.722198    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf347cca-07c1-4605-89bd-c8e8435883fc-kube-api-access-mb5mt" (OuterVolumeSpecName: "kube-api-access-mb5mt") pod "cf347cca-07c1-4605-89bd-c8e8435883fc" (UID: "cf347cca-07c1-4605-89bd-c8e8435883fc"). InnerVolumeSpecName "kube-api-access-mb5mt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:00:19.722329 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.722178    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d605e0b9-3e1d-40ec-ba30-927a1942baf7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d605e0b9-3e1d-40ec-ba30-927a1942baf7" (UID: "d605e0b9-3e1d-40ec-ba30-927a1942baf7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:00:19.722329 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.722184    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d605e0b9-3e1d-40ec-ba30-927a1942baf7-kube-api-access-p6tzk" (OuterVolumeSpecName: "kube-api-access-p6tzk") pod "d605e0b9-3e1d-40ec-ba30-927a1942baf7" (UID: "d605e0b9-3e1d-40ec-ba30-927a1942baf7"). InnerVolumeSpecName "kube-api-access-p6tzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:00:19.740651 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.740618    2580 patch_prober.go:28] interesting pod/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 18:00:19.740768 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.740698    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m" podUID="faf63eac-cc01-4492-a13c-16ea05f0a9eb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 18:00:19.821892 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.821867    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb5mt\" (UniqueName: \"kubernetes.io/projected/cf347cca-07c1-4605-89bd-c8e8435883fc-kube-api-access-mb5mt\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:00:19.821892 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.821889    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d106bdd6-15e6-401a-92a9-6e8d0743771f-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:00:19.822292 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.821907    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7wtn\" (UniqueName: \"kubernetes.io/projected/d106bdd6-15e6-401a-92a9-6e8d0743771f-kube-api-access-j7wtn\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:00:19.822292 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.821917    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d605e0b9-3e1d-40ec-ba30-927a1942baf7-maas-api-tls\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:00:19.822292 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.821927    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d605e0b9-3e1d-40ec-ba30-927a1942baf7-openshift-service-ca\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:00:19.822292 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:19.821936    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6tzk\" (UniqueName: \"kubernetes.io/projected/d605e0b9-3e1d-40ec-ba30-927a1942baf7-kube-api-access-p6tzk\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:00:20.093114 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.093074    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"]
Jul 27 18:00:20.093619 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.093573    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d106bdd6-15e6-401a-92a9-6e8d0743771f" containerName="payload-pre-processing"
Jul 27 18:00:20.093619 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.093610    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d106bdd6-15e6-401a-92a9-6e8d0743771f" containerName="payload-pre-processing"
Jul 27 18:00:20.093619 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.093619    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d605e0b9-3e1d-40ec-ba30-927a1942baf7" containerName="maas-api"
Jul 27 18:00:20.093619 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.093624    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d605e0b9-3e1d-40ec-ba30-927a1942baf7" containerName="maas-api"
Jul 27 18:00:20.093918 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.093637    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf347cca-07c1-4605-89bd-c8e8435883fc" containerName="payload-processing"
Jul 27 18:00:20.093918 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.093645    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf347cca-07c1-4605-89bd-c8e8435883fc" containerName="payload-processing"
Jul 27 18:00:20.093918 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.093751    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d106bdd6-15e6-401a-92a9-6e8d0743771f" containerName="payload-pre-processing"
Jul 27 18:00:20.093918 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.093765    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d605e0b9-3e1d-40ec-ba30-927a1942baf7" containerName="maas-api"
Jul 27 18:00:20.093918 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.093776    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf347cca-07c1-4605-89bd-c8e8435883fc" containerName="payload-processing"
Jul 27 18:00:20.096771 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.096753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.099064 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.099043    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-77a616d7-openshift-default-dockercfg-xcsh2\""
Jul 27 18:00:20.107910 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.107886    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"]
Jul 27 18:00:20.226256 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.226221    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-podinfo\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.226256 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.226258    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-workload-certs\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.226477 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.226277    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-token\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.226477 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.226355    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flrw7\" (UniqueName: \"kubernetes.io/projected/8089deb8-cf32-42d7-aa56-f4293388d8dc-kube-api-access-flrw7\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.226477 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.226420    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-envoy\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.226477 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.226454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-data\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.226665 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.226490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8089deb8-cf32-42d7-aa56-f4293388d8dc-istiod-ca-cert\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.226665 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.226534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-credential-socket\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.226665 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.226552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-workload-socket\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.327822 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.327791    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-data\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.327977 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.327836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8089deb8-cf32-42d7-aa56-f4293388d8dc-istiod-ca-cert\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.327977 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.327874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-credential-socket\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.327977 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.327892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-workload-socket\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.327977 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.327919    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-podinfo\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.327977 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.327938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-workload-certs\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.327977 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.327954    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-token\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.328304 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.328029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flrw7\" (UniqueName: \"kubernetes.io/projected/8089deb8-cf32-42d7-aa56-f4293388d8dc-kube-api-access-flrw7\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.328304 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.328098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-envoy\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.328304 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.328255    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-data\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.328304 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.328296    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-credential-socket\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.328526 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.328335    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-workload-socket\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.328526 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.328373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-workload-certs\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.328936 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.328912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8089deb8-cf32-42d7-aa56-f4293388d8dc-istiod-ca-cert\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.330207 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.330186    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-envoy\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.330480 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.330462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-podinfo\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.335397 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.335376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-token\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.335633 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.335612    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flrw7\" (UniqueName: \"kubernetes.io/projected/8089deb8-cf32-42d7-aa56-f4293388d8dc-kube-api-access-flrw7\") pod \"e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") " pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.373415 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.373350    2580 generic.go:356] "Generic (PLEG): container finished" podID="d605e0b9-3e1d-40ec-ba30-927a1942baf7" containerID="bc05f130b37bf2f8bd014eed68a53399c137f98838decba9024ee715de52c21b" exitCode=0
Jul 27 18:00:20.373415 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.373407    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"
Jul 27 18:00:20.373614 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.373440    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777" event={"ID":"d605e0b9-3e1d-40ec-ba30-927a1942baf7","Type":"ContainerDied","Data":"bc05f130b37bf2f8bd014eed68a53399c137f98838decba9024ee715de52c21b"}
Jul 27 18:00:20.373614 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.373498    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777" event={"ID":"d605e0b9-3e1d-40ec-ba30-927a1942baf7","Type":"ContainerDied","Data":"e08b38442a1a5e1fc837d093554167f85010cdcc303f83e57e68040f2385b3c9"}
Jul 27 18:00:20.373614 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.373529    2580 scope.go:117] "RemoveContainer" containerID="bc05f130b37bf2f8bd014eed68a53399c137f98838decba9024ee715de52c21b"
Jul 27 18:00:20.376648 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.375709    2580 generic.go:356] "Generic (PLEG): container finished" podID="d106bdd6-15e6-401a-92a9-6e8d0743771f" containerID="03e413667c24a468190262456cb84c5aeb9d306e21a666c46a0ff4536b5b4522" exitCode=0
Jul 27 18:00:20.376648 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.375855    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"
Jul 27 18:00:20.376648 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.375909    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn" event={"ID":"d106bdd6-15e6-401a-92a9-6e8d0743771f","Type":"ContainerDied","Data":"03e413667c24a468190262456cb84c5aeb9d306e21a666c46a0ff4536b5b4522"}
Jul 27 18:00:20.376648 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.376255    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn" event={"ID":"d106bdd6-15e6-401a-92a9-6e8d0743771f","Type":"ContainerDied","Data":"3d54438cfddf60562176698c261494bd598b6b0409b3279e6d0a87fe91af3a0b"}
Jul 27 18:00:20.379185 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.377657    2580 generic.go:356] "Generic (PLEG): container finished" podID="cf347cca-07c1-4605-89bd-c8e8435883fc" containerID="882eed72747746ca0abe36b80580794f92bae29830d23f19bbc7d4f52928c916" exitCode=0
Jul 27 18:00:20.379185 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.377731    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4" event={"ID":"cf347cca-07c1-4605-89bd-c8e8435883fc","Type":"ContainerDied","Data":"882eed72747746ca0abe36b80580794f92bae29830d23f19bbc7d4f52928c916"}
Jul 27 18:00:20.379185 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.377781    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4" event={"ID":"cf347cca-07c1-4605-89bd-c8e8435883fc","Type":"ContainerDied","Data":"00bcb7bc551cccdd727a4aac08c5eea361b762c775eb70491825204f53b4ff65"}
Jul 27 18:00:20.379185 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.377873    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"
Jul 27 18:00:20.386760 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.386653    2580 scope.go:117] "RemoveContainer" containerID="bc05f130b37bf2f8bd014eed68a53399c137f98838decba9024ee715de52c21b"
Jul 27 18:00:20.386985 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:00:20.386943    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc05f130b37bf2f8bd014eed68a53399c137f98838decba9024ee715de52c21b\": container with ID starting with bc05f130b37bf2f8bd014eed68a53399c137f98838decba9024ee715de52c21b not found: ID does not exist" containerID="bc05f130b37bf2f8bd014eed68a53399c137f98838decba9024ee715de52c21b"
Jul 27 18:00:20.387075 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.387008    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc05f130b37bf2f8bd014eed68a53399c137f98838decba9024ee715de52c21b"} err="failed to get container status \"bc05f130b37bf2f8bd014eed68a53399c137f98838decba9024ee715de52c21b\": rpc error: code = NotFound desc = could not find container \"bc05f130b37bf2f8bd014eed68a53399c137f98838decba9024ee715de52c21b\": container with ID starting with bc05f130b37bf2f8bd014eed68a53399c137f98838decba9024ee715de52c21b not found: ID does not exist"
Jul 27 18:00:20.387075 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.387038    2580 scope.go:117] "RemoveContainer" containerID="03e413667c24a468190262456cb84c5aeb9d306e21a666c46a0ff4536b5b4522"
Jul 27 18:00:20.396121 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.396104    2580 scope.go:117] "RemoveContainer" containerID="03e413667c24a468190262456cb84c5aeb9d306e21a666c46a0ff4536b5b4522"
Jul 27 18:00:20.396358 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:00:20.396339    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03e413667c24a468190262456cb84c5aeb9d306e21a666c46a0ff4536b5b4522\": container with ID starting with 03e413667c24a468190262456cb84c5aeb9d306e21a666c46a0ff4536b5b4522 not found: ID does not exist" containerID="03e413667c24a468190262456cb84c5aeb9d306e21a666c46a0ff4536b5b4522"
Jul 27 18:00:20.396410 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.396364    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03e413667c24a468190262456cb84c5aeb9d306e21a666c46a0ff4536b5b4522"} err="failed to get container status \"03e413667c24a468190262456cb84c5aeb9d306e21a666c46a0ff4536b5b4522\": rpc error: code = NotFound desc = could not find container \"03e413667c24a468190262456cb84c5aeb9d306e21a666c46a0ff4536b5b4522\": container with ID starting with 03e413667c24a468190262456cb84c5aeb9d306e21a666c46a0ff4536b5b4522 not found: ID does not exist"
Jul 27 18:00:20.396410 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.396381    2580 scope.go:117] "RemoveContainer" containerID="882eed72747746ca0abe36b80580794f92bae29830d23f19bbc7d4f52928c916"
Jul 27 18:00:20.403647 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.403623    2580 scope.go:117] "RemoveContainer" containerID="882eed72747746ca0abe36b80580794f92bae29830d23f19bbc7d4f52928c916"
Jul 27 18:00:20.403921 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:00:20.403899    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"882eed72747746ca0abe36b80580794f92bae29830d23f19bbc7d4f52928c916\": container with ID starting with 882eed72747746ca0abe36b80580794f92bae29830d23f19bbc7d4f52928c916 not found: ID does not exist" containerID="882eed72747746ca0abe36b80580794f92bae29830d23f19bbc7d4f52928c916"
Jul 27 18:00:20.403992 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.403929    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"882eed72747746ca0abe36b80580794f92bae29830d23f19bbc7d4f52928c916"} err="failed to get container status \"882eed72747746ca0abe36b80580794f92bae29830d23f19bbc7d4f52928c916\": rpc error: code = NotFound desc = could not find container \"882eed72747746ca0abe36b80580794f92bae29830d23f19bbc7d4f52928c916\": container with ID starting with 882eed72747746ca0abe36b80580794f92bae29830d23f19bbc7d4f52928c916 not found: ID does not exist"
Jul 27 18:00:20.404195 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.404180    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"]
Jul 27 18:00:20.408280 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.408254    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:20.408918 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.408901    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea7cbb1a-7b5b78c4f7-s4777"]
Jul 27 18:00:20.426487 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.426464    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"]
Jul 27 18:00:20.429355 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.429333    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ea7cbb1a-74bbcbc65d-thnw4"]
Jul 27 18:00:20.437852 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.437831    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"]
Jul 27 18:00:20.440023 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.440005    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ea7cbb1a-564946bb68-kx6fn"]
Jul 27 18:00:20.552689 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.552662    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"]
Jul 27 18:00:20.554563 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:00:20.554534    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8089deb8_cf32_42d7_aa56_f4293388d8dc.slice/crio-df2d6a2f7fe21987028208864958808e36afe13e97b25de9336ff4f107e2d5fd WatchSource:0}: Error finding container df2d6a2f7fe21987028208864958808e36afe13e97b25de9336ff4f107e2d5fd: Status 404 returned error can't find the container with id df2d6a2f7fe21987028208864958808e36afe13e97b25de9336ff4f107e2d5fd
Jul 27 18:00:20.556846 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.556813    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:00:20.556922 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.556881    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:00:20.556922 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:20.556914    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:00:21.385690 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:21.385650    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw" event={"ID":"8089deb8-cf32-42d7-aa56-f4293388d8dc","Type":"ContainerStarted","Data":"65d5592ecda447b8b44b59ebdbbd0ce5074868e7f3dcaa3bf8a42b93dc732994"}
Jul 27 18:00:21.386199 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:21.385709    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw" event={"ID":"8089deb8-cf32-42d7-aa56-f4293388d8dc","Type":"ContainerStarted","Data":"df2d6a2f7fe21987028208864958808e36afe13e97b25de9336ff4f107e2d5fd"}
Jul 27 18:00:21.406304 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:21.406252    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw" podStartSLOduration=1.406237034 podStartE2EDuration="1.406237034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:00:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:00:21.405376258 +0000 UTC m=+2164.420042702" watchObservedRunningTime="2026-07-27 18:00:21.406237034 +0000 UTC m=+2164.420903531"
Jul 27 18:00:21.408434 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:21.408406    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:21.413718 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:21.413695    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:21.476751 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:21.476723    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf347cca-07c1-4605-89bd-c8e8435883fc" path="/var/lib/kubelet/pods/cf347cca-07c1-4605-89bd-c8e8435883fc/volumes"
Jul 27 18:00:21.477106 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:21.477093    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d106bdd6-15e6-401a-92a9-6e8d0743771f" path="/var/lib/kubelet/pods/d106bdd6-15e6-401a-92a9-6e8d0743771f/volumes"
Jul 27 18:00:21.477500 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:21.477486    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d605e0b9-3e1d-40ec-ba30-927a1942baf7" path="/var/lib/kubelet/pods/d605e0b9-3e1d-40ec-ba30-927a1942baf7/volumes"
Jul 27 18:00:22.391729 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:22.391698    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:22.392687 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:22.392669    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:23.520684 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:23.520652    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"]
Jul 27 18:00:23.524058 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:23.524041    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"
Jul 27 18:00:23.526059 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:23.526042    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-77a616d7-serving-cert\""
Jul 27 18:00:23.534296 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:23.534271    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"]
Jul 27 18:00:23.657216 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:23.657178    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-openshift-service-ca\") pod \"maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw\" (UID: \"c4796ec6-aa9f-4569-81ca-32e1cd050eb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"
Jul 27 18:00:23.657216 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:23.657216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh7jb\" (UniqueName: \"kubernetes.io/projected/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-kube-api-access-hh7jb\") pod \"maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw\" (UID: \"c4796ec6-aa9f-4569-81ca-32e1cd050eb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"
Jul 27 18:00:23.657431 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:23.657274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-maas-api-tls\") pod \"maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw\" (UID: \"c4796ec6-aa9f-4569-81ca-32e1cd050eb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"
Jul 27 18:00:23.758665 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:23.758541    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-openshift-service-ca\") pod \"maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw\" (UID: \"c4796ec6-aa9f-4569-81ca-32e1cd050eb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"
Jul 27 18:00:23.758665 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:23.758599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh7jb\" (UniqueName: \"kubernetes.io/projected/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-kube-api-access-hh7jb\") pod \"maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw\" (UID: \"c4796ec6-aa9f-4569-81ca-32e1cd050eb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"
Jul 27 18:00:23.758665 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:23.758649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-maas-api-tls\") pod \"maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw\" (UID: \"c4796ec6-aa9f-4569-81ca-32e1cd050eb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"
Jul 27 18:00:23.758958 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:00:23.758829    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-serving-cert: secret "maas-api-e2e-mt-77a616d7-serving-cert" not found
Jul 27 18:00:23.758958 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:00:23.758900    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-maas-api-tls podName:c4796ec6-aa9f-4569-81ca-32e1cd050eb0 nodeName:}" failed. No retries permitted until 2026-07-27 18:00:24.258876439 +0000 UTC m=+2167.273542863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-maas-api-tls") pod "maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw" (UID: "c4796ec6-aa9f-4569-81ca-32e1cd050eb0") : secret "maas-api-e2e-mt-77a616d7-serving-cert" not found
Jul 27 18:00:23.759233 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:23.759211    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-openshift-service-ca\") pod \"maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw\" (UID: \"c4796ec6-aa9f-4569-81ca-32e1cd050eb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"
Jul 27 18:00:23.766478 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:23.766455    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh7jb\" (UniqueName: \"kubernetes.io/projected/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-kube-api-access-hh7jb\") pod \"maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw\" (UID: \"c4796ec6-aa9f-4569-81ca-32e1cd050eb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"
Jul 27 18:00:24.227159 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.227127    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"]
Jul 27 18:00:24.230812 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.230794    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"
Jul 27 18:00:24.232967 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.232948    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-77a616d7\""
Jul 27 18:00:24.233034 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.232997    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-77a616d7-dockercfg-xbw7r\""
Jul 27 18:00:24.239772 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.239748    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"]
Jul 27 18:00:24.259137 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.259113    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"]
Jul 27 18:00:24.262503 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.262487    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"
Jul 27 18:00:24.263616 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.263589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-maas-api-tls\") pod \"maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw\" (UID: \"c4796ec6-aa9f-4569-81ca-32e1cd050eb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"
Jul 27 18:00:24.265832 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.265814    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-maas-api-tls\") pod \"maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw\" (UID: \"c4796ec6-aa9f-4569-81ca-32e1cd050eb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"
Jul 27 18:00:24.272308 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.272287    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"]
Jul 27 18:00:24.364541 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.364503    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g62gq\" (UniqueName: \"kubernetes.io/projected/a881115a-7418-48c2-a61f-7a1aff5f5058-kube-api-access-g62gq\") pod \"payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw\" (UID: \"a881115a-7418-48c2-a61f-7a1aff5f5058\") " pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"
Jul 27 18:00:24.364701 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.364634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a881115a-7418-48c2-a61f-7a1aff5f5058-plugins-config-volume\") pod \"payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw\" (UID: \"a881115a-7418-48c2-a61f-7a1aff5f5058\") " pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"
Jul 27 18:00:24.364701 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.364677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txblt\" (UniqueName: \"kubernetes.io/projected/4442b2c6-704b-4d7a-a35d-6cd302348489-kube-api-access-txblt\") pod \"payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq\" (UID: \"4442b2c6-704b-4d7a-a35d-6cd302348489\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"
Jul 27 18:00:24.364791 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.364721    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4442b2c6-704b-4d7a-a35d-6cd302348489-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq\" (UID: \"4442b2c6-704b-4d7a-a35d-6cd302348489\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"
Jul 27 18:00:24.406486 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.405628    2580 generic.go:356] "Generic (PLEG): container finished" podID="faf63eac-cc01-4492-a13c-16ea05f0a9eb" containerID="86e08b3ee1a2f624ce74c41badc7e091a107260afecfefde1e04950d79ca1d96" exitCode=0
Jul 27 18:00:24.406486 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.405721    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m" event={"ID":"faf63eac-cc01-4492-a13c-16ea05f0a9eb","Type":"ContainerDied","Data":"86e08b3ee1a2f624ce74c41badc7e091a107260afecfefde1e04950d79ca1d96"}
Jul 27 18:00:24.406486 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.405823    2580 scope.go:117] "RemoveContainer" containerID="f2c25f4b8970ae2605433a47fc7ce14b2eecfcd46c6f6c84c9062e602177f9dc"
Jul 27 18:00:24.437016 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.436986    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"
Jul 27 18:00:24.466234 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.466193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a881115a-7418-48c2-a61f-7a1aff5f5058-plugins-config-volume\") pod \"payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw\" (UID: \"a881115a-7418-48c2-a61f-7a1aff5f5058\") " pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"
Jul 27 18:00:24.466412 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.466262    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txblt\" (UniqueName: \"kubernetes.io/projected/4442b2c6-704b-4d7a-a35d-6cd302348489-kube-api-access-txblt\") pod \"payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq\" (UID: \"4442b2c6-704b-4d7a-a35d-6cd302348489\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"
Jul 27 18:00:24.466412 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.466318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4442b2c6-704b-4d7a-a35d-6cd302348489-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq\" (UID: \"4442b2c6-704b-4d7a-a35d-6cd302348489\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"
Jul 27 18:00:24.466412 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.466387    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g62gq\" (UniqueName: \"kubernetes.io/projected/a881115a-7418-48c2-a61f-7a1aff5f5058-kube-api-access-g62gq\") pod \"payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw\" (UID: \"a881115a-7418-48c2-a61f-7a1aff5f5058\") " pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"
Jul 27 18:00:24.467036 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.467010    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a881115a-7418-48c2-a61f-7a1aff5f5058-plugins-config-volume\") pod \"payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw\" (UID: \"a881115a-7418-48c2-a61f-7a1aff5f5058\") " pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"
Jul 27 18:00:24.467397 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.467370    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4442b2c6-704b-4d7a-a35d-6cd302348489-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq\" (UID: \"4442b2c6-704b-4d7a-a35d-6cd302348489\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"
Jul 27 18:00:24.476892 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.476867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g62gq\" (UniqueName: \"kubernetes.io/projected/a881115a-7418-48c2-a61f-7a1aff5f5058-kube-api-access-g62gq\") pod \"payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw\" (UID: \"a881115a-7418-48c2-a61f-7a1aff5f5058\") " pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"
Jul 27 18:00:24.477786 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.477628    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txblt\" (UniqueName: \"kubernetes.io/projected/4442b2c6-704b-4d7a-a35d-6cd302348489-kube-api-access-txblt\") pod \"payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq\" (UID: \"4442b2c6-704b-4d7a-a35d-6cd302348489\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"
Jul 27 18:00:24.527943 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.527898    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 18:00:24.543217 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.543188    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"
Jul 27 18:00:24.585801 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.585770    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"
Jul 27 18:00:24.591515 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.591493    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"]
Jul 27 18:00:24.597201 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:00:24.597169    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4796ec6_aa9f_4569_81ca_32e1cd050eb0.slice/crio-5512d1b8486cd53e145839e416773208768b1ded8bd02240dc205267fe732c38 WatchSource:0}: Error finding container 5512d1b8486cd53e145839e416773208768b1ded8bd02240dc205267fe732c38: Status 404 returned error can't find the container with id 5512d1b8486cd53e145839e416773208768b1ded8bd02240dc205267fe732c38
Jul 27 18:00:24.598433 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.598416    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:00:24.669447 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.669406    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-workload-certs\") pod \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") "
Jul 27 18:00:24.669646 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.669484    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-credential-socket\") pod \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") "
Jul 27 18:00:24.669646 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.669517    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-data\") pod \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") "
Jul 27 18:00:24.669765 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.669659    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-podinfo\") pod \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") "
Jul 27 18:00:24.669765 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.669686    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istiod-ca-cert\") pod \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") "
Jul 27 18:00:24.669765 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.669738    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-envoy\") pod \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") "
Jul 27 18:00:24.669923 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.669781    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-workload-socket\") pod \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") "
Jul 27 18:00:24.669923 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.669805    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "faf63eac-cc01-4492-a13c-16ea05f0a9eb" (UID: "faf63eac-cc01-4492-a13c-16ea05f0a9eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:00:24.669923 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.669820    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-token\") pod \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") "
Jul 27 18:00:24.670070 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.669936    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tl892\" (UniqueName: \"kubernetes.io/projected/faf63eac-cc01-4492-a13c-16ea05f0a9eb-kube-api-access-tl892\") pod \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\" (UID: \"faf63eac-cc01-4492-a13c-16ea05f0a9eb\") "
Jul 27 18:00:24.672020 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.670275    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:00:24.672020 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.670816    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "faf63eac-cc01-4492-a13c-16ea05f0a9eb" (UID: "faf63eac-cc01-4492-a13c-16ea05f0a9eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:00:24.672020 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.671007    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "faf63eac-cc01-4492-a13c-16ea05f0a9eb" (UID: "faf63eac-cc01-4492-a13c-16ea05f0a9eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:00:24.672020 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.671834    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "faf63eac-cc01-4492-a13c-16ea05f0a9eb" (UID: "faf63eac-cc01-4492-a13c-16ea05f0a9eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:00:24.672020 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.671992    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "faf63eac-cc01-4492-a13c-16ea05f0a9eb" (UID: "faf63eac-cc01-4492-a13c-16ea05f0a9eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:00:24.673321 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.673292    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "faf63eac-cc01-4492-a13c-16ea05f0a9eb" (UID: "faf63eac-cc01-4492-a13c-16ea05f0a9eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:00:24.673449 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.673419    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "faf63eac-cc01-4492-a13c-16ea05f0a9eb" (UID: "faf63eac-cc01-4492-a13c-16ea05f0a9eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 18:00:24.675087 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.675058    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faf63eac-cc01-4492-a13c-16ea05f0a9eb-kube-api-access-tl892" (OuterVolumeSpecName: "kube-api-access-tl892") pod "faf63eac-cc01-4492-a13c-16ea05f0a9eb" (UID: "faf63eac-cc01-4492-a13c-16ea05f0a9eb"). InnerVolumeSpecName "kube-api-access-tl892". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:00:24.675353 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.675334    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "faf63eac-cc01-4492-a13c-16ea05f0a9eb" (UID: "faf63eac-cc01-4492-a13c-16ea05f0a9eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:00:24.702220 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.702162    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"]
Jul 27 18:00:24.704552 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:00:24.704519    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4442b2c6_704b_4d7a_a35d_6cd302348489.slice/crio-8f1a6abb5868226f2f8c36c9e150cda41caed3a70c2bb17b7bb85fb85448e97e WatchSource:0}: Error finding container 8f1a6abb5868226f2f8c36c9e150cda41caed3a70c2bb17b7bb85fb85448e97e: Status 404 returned error can't find the container with id 8f1a6abb5868226f2f8c36c9e150cda41caed3a70c2bb17b7bb85fb85448e97e
Jul 27 18:00:24.771118 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.771095    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:00:24.771238 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.771120    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:00:24.771238 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.771136    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:00:24.771238 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.771148    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:00:24.771238 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.771160    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:00:24.771238 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.771172    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tl892\" (UniqueName: \"kubernetes.io/projected/faf63eac-cc01-4492-a13c-16ea05f0a9eb-kube-api-access-tl892\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:00:24.771238 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.771188    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:00:24.771238 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.771201    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/faf63eac-cc01-4492-a13c-16ea05f0a9eb-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:00:24.953788 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:24.953758    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"]
Jul 27 18:00:24.955011 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:00:24.954985    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda881115a_7418_48c2_a61f_7a1aff5f5058.slice/crio-9934f1069bc8b55e7723057ea5d4b90d1c3f051cb1218cb05d8dad98aa894217 WatchSource:0}: Error finding container 9934f1069bc8b55e7723057ea5d4b90d1c3f051cb1218cb05d8dad98aa894217: Status 404 returned error can't find the container with id 9934f1069bc8b55e7723057ea5d4b90d1c3f051cb1218cb05d8dad98aa894217
Jul 27 18:00:25.412035 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:25.411997    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq" event={"ID":"4442b2c6-704b-4d7a-a35d-6cd302348489","Type":"ContainerStarted","Data":"50b66362c7b278cb38e6b2c01347223df494273ede7ef30bb8d34e5a04c53827"}
Jul 27 18:00:25.412190 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:25.412054    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq" event={"ID":"4442b2c6-704b-4d7a-a35d-6cd302348489","Type":"ContainerStarted","Data":"8f1a6abb5868226f2f8c36c9e150cda41caed3a70c2bb17b7bb85fb85448e97e"}
Jul 27 18:00:25.412190 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:25.412110    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"
Jul 27 18:00:25.413393 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:25.413372    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"
Jul 27 18:00:25.413518 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:25.413421    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m" event={"ID":"faf63eac-cc01-4492-a13c-16ea05f0a9eb","Type":"ContainerDied","Data":"9254a9b6ef07a9d5c28c0ca287cf75430705261df5b412fd5ee278104a5dd5ea"}
Jul 27 18:00:25.413518 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:25.413473    2580 scope.go:117] "RemoveContainer" containerID="86e08b3ee1a2f624ce74c41badc7e091a107260afecfefde1e04950d79ca1d96"
Jul 27 18:00:25.418284 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:25.418205    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw" event={"ID":"c4796ec6-aa9f-4569-81ca-32e1cd050eb0","Type":"ContainerStarted","Data":"5512d1b8486cd53e145839e416773208768b1ded8bd02240dc205267fe732c38"}
Jul 27 18:00:25.420676 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:25.420643    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw" event={"ID":"a881115a-7418-48c2-a61f-7a1aff5f5058","Type":"ContainerStarted","Data":"780d6150e47bb60fb55abec5c45bceaf4d6b5f08a7481cc96b50a33aa8992709"}
Jul 27 18:00:25.420781 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:25.420687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw" event={"ID":"a881115a-7418-48c2-a61f-7a1aff5f5058","Type":"ContainerStarted","Data":"9934f1069bc8b55e7723057ea5d4b90d1c3f051cb1218cb05d8dad98aa894217"}
Jul 27 18:00:25.420781 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:25.420770    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"
Jul 27 18:00:25.434119 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:25.434079    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq" podStartSLOduration=1.4340636199999999 podStartE2EDuration="1.43406362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:00:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:00:25.432477039 +0000 UTC m=+2168.447143483" watchObservedRunningTime="2026-07-27 18:00:25.43406362 +0000 UTC m=+2168.448730063"
Jul 27 18:00:25.536912 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:25.536879    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"]
Jul 27 18:00:25.539273 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:25.539260    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ea7cbb1a-openshift-default-54fbd57fd4-cmm2m"]
Jul 27 18:00:25.541609 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:25.541542    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw" podStartSLOduration=1.5415226340000001 podStartE2EDuration="1.541522634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:00:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:00:25.465017115 +0000 UTC m=+2168.479683558" watchObservedRunningTime="2026-07-27 18:00:25.541522634 +0000 UTC m=+2168.556189082"
Jul 27 18:00:27.434614 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:27.434556    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw" event={"ID":"c4796ec6-aa9f-4569-81ca-32e1cd050eb0","Type":"ContainerStarted","Data":"a88025c2038f1639740b387f1e9c26fec9bb341f4a1bb24e93e399e47e433197"}
Jul 27 18:00:27.435098 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:27.434743    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"
Jul 27 18:00:27.452637 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:27.452567    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw" podStartSLOduration=2.025967944 podStartE2EDuration="4.45255162s" totalImagesPullingTime="2.426583676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:00:27.449639206 +0000 UTC m=+2170.464305650" watchObservedRunningTime="2026-07-27 18:00:27.45255162 +0000 UTC m=+2170.467218064"
Jul 27 18:00:27.476945 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:27.476920    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faf63eac-cc01-4492-a13c-16ea05f0a9eb" path="/var/lib/kubelet/pods/faf63eac-cc01-4492-a13c-16ea05f0a9eb/volumes"
Jul 27 18:00:33.454239 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:33.454197    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"
Jul 27 18:00:36.430468 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:36.430431    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"
Jul 27 18:00:36.430933 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:36.430617    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"
Jul 27 18:00:37.393529 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:37.393490    2580 patch_prober.go:28] interesting pod/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 27 18:00:37.393756 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:37.393545    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw" podUID="8089deb8-cf32-42d7-aa56-f4293388d8dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 27 18:00:37.496273 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:37.496242    2580 generic.go:356] "Generic (PLEG): container finished" podID="8089deb8-cf32-42d7-aa56-f4293388d8dc" containerID="65d5592ecda447b8b44b59ebdbbd0ce5074868e7f3dcaa3bf8a42b93dc732994" exitCode=0
Jul 27 18:00:37.496662 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:37.496312    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw" event={"ID":"8089deb8-cf32-42d7-aa56-f4293388d8dc","Type":"ContainerDied","Data":"65d5592ecda447b8b44b59ebdbbd0ce5074868e7f3dcaa3bf8a42b93dc732994"}
Jul 27 18:00:37.496758 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:37.496669    2580 scope.go:117] "RemoveContainer" containerID="65d5592ecda447b8b44b59ebdbbd0ce5074868e7f3dcaa3bf8a42b93dc732994"
Jul 27 18:00:37.497670 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:37.497643    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:00:37.497734 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:37.497721    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:00:37.497775 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:37.497756    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:00:38.502656 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:38.502618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw" event={"ID":"8089deb8-cf32-42d7-aa56-f4293388d8dc","Type":"ContainerStarted","Data":"ccc70b5af96ed4d579718964e0706c1225cfce87fb8430ac194967762e6ec2bd"}
Jul 27 18:00:39.408717 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:39.408682    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:39.408922 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:39.408875    2580 patch_prober.go:28] interesting pod/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 27 18:00:39.409002 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:39.408933    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw" podUID="8089deb8-cf32-42d7-aa56-f4293388d8dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 27 18:00:40.408964 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:40.408924    2580 patch_prober.go:28] interesting pod/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 27 18:00:40.409462 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:40.408990    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw" podUID="8089deb8-cf32-42d7-aa56-f4293388d8dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 27 18:00:41.409103 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:41.409070    2580 patch_prober.go:28] interesting pod/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 27 18:00:41.409496 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:41.409141    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw" podUID="8089deb8-cf32-42d7-aa56-f4293388d8dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 27 18:00:42.412535 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:42.412505    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:42.413043 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:42.412905    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:00:42.413480 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:00:42.413457    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:04:20.436177 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.436138    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"]
Jul 27 18:04:20.436831 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.436414    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw" podUID="c4796ec6-aa9f-4569-81ca-32e1cd050eb0" containerName="maas-api" containerID="cri-o://a88025c2038f1639740b387f1e9c26fec9bb341f4a1bb24e93e399e47e433197" gracePeriod=30
Jul 27 18:04:20.492494 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.492463    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"]
Jul 27 18:04:20.492731 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.492706    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw" podUID="a881115a-7418-48c2-a61f-7a1aff5f5058" containerName="payload-processing" containerID="cri-o://780d6150e47bb60fb55abec5c45bceaf4d6b5f08a7481cc96b50a33aa8992709" gracePeriod=30
Jul 27 18:04:20.501209 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.501183    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"]
Jul 27 18:04:20.501542 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.501475    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq" podUID="4442b2c6-704b-4d7a-a35d-6cd302348489" containerName="payload-pre-processing" containerID="cri-o://50b66362c7b278cb38e6b2c01347223df494273ede7ef30bb8d34e5a04c53827" gracePeriod=30
Jul 27 18:04:20.597450 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.597416    2580 generic.go:356] "Generic (PLEG): container finished" podID="c4796ec6-aa9f-4569-81ca-32e1cd050eb0" containerID="a88025c2038f1639740b387f1e9c26fec9bb341f4a1bb24e93e399e47e433197" exitCode=0
Jul 27 18:04:20.597630 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.597499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw" event={"ID":"c4796ec6-aa9f-4569-81ca-32e1cd050eb0","Type":"ContainerDied","Data":"a88025c2038f1639740b387f1e9c26fec9bb341f4a1bb24e93e399e47e433197"}
Jul 27 18:04:20.781263 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.781238    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"
Jul 27 18:04:20.784318 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.784299    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"
Jul 27 18:04:20.804925 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.804842    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"
Jul 27 18:04:20.858617 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.858566    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-openshift-service-ca\") pod \"c4796ec6-aa9f-4569-81ca-32e1cd050eb0\" (UID: \"c4796ec6-aa9f-4569-81ca-32e1cd050eb0\") "
Jul 27 18:04:20.858793 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.858633    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4442b2c6-704b-4d7a-a35d-6cd302348489-plugins-config-volume\") pod \"4442b2c6-704b-4d7a-a35d-6cd302348489\" (UID: \"4442b2c6-704b-4d7a-a35d-6cd302348489\") "
Jul 27 18:04:20.858793 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.858675    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh7jb\" (UniqueName: \"kubernetes.io/projected/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-kube-api-access-hh7jb\") pod \"c4796ec6-aa9f-4569-81ca-32e1cd050eb0\" (UID: \"c4796ec6-aa9f-4569-81ca-32e1cd050eb0\") "
Jul 27 18:04:20.858793 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.858702    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a881115a-7418-48c2-a61f-7a1aff5f5058-plugins-config-volume\") pod \"a881115a-7418-48c2-a61f-7a1aff5f5058\" (UID: \"a881115a-7418-48c2-a61f-7a1aff5f5058\") "
Jul 27 18:04:20.858793 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.858787    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-maas-api-tls\") pod \"c4796ec6-aa9f-4569-81ca-32e1cd050eb0\" (UID: \"c4796ec6-aa9f-4569-81ca-32e1cd050eb0\") "
Jul 27 18:04:20.859008 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.858811    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g62gq\" (UniqueName: \"kubernetes.io/projected/a881115a-7418-48c2-a61f-7a1aff5f5058-kube-api-access-g62gq\") pod \"a881115a-7418-48c2-a61f-7a1aff5f5058\" (UID: \"a881115a-7418-48c2-a61f-7a1aff5f5058\") "
Jul 27 18:04:20.859008 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.858849    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txblt\" (UniqueName: \"kubernetes.io/projected/4442b2c6-704b-4d7a-a35d-6cd302348489-kube-api-access-txblt\") pod \"4442b2c6-704b-4d7a-a35d-6cd302348489\" (UID: \"4442b2c6-704b-4d7a-a35d-6cd302348489\") "
Jul 27 18:04:20.859008 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.858907    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c4796ec6-aa9f-4569-81ca-32e1cd050eb0" (UID: "c4796ec6-aa9f-4569-81ca-32e1cd050eb0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:04:20.859151 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.859093    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4442b2c6-704b-4d7a-a35d-6cd302348489-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4442b2c6-704b-4d7a-a35d-6cd302348489" (UID: "4442b2c6-704b-4d7a-a35d-6cd302348489"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:04:20.859216 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.859136    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a881115a-7418-48c2-a61f-7a1aff5f5058-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a881115a-7418-48c2-a61f-7a1aff5f5058" (UID: "a881115a-7418-48c2-a61f-7a1aff5f5058"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:04:20.859275 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.859229    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-openshift-service-ca\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:04:20.859275 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.859248    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4442b2c6-704b-4d7a-a35d-6cd302348489-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:04:20.859275 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.859262    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a881115a-7418-48c2-a61f-7a1aff5f5058-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:04:20.860979 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.860948    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-kube-api-access-hh7jb" (OuterVolumeSpecName: "kube-api-access-hh7jb") pod "c4796ec6-aa9f-4569-81ca-32e1cd050eb0" (UID: "c4796ec6-aa9f-4569-81ca-32e1cd050eb0"). InnerVolumeSpecName "kube-api-access-hh7jb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:04:20.861089 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.861027    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4442b2c6-704b-4d7a-a35d-6cd302348489-kube-api-access-txblt" (OuterVolumeSpecName: "kube-api-access-txblt") pod "4442b2c6-704b-4d7a-a35d-6cd302348489" (UID: "4442b2c6-704b-4d7a-a35d-6cd302348489"). InnerVolumeSpecName "kube-api-access-txblt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:04:20.861278 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.861252    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c4796ec6-aa9f-4569-81ca-32e1cd050eb0" (UID: "c4796ec6-aa9f-4569-81ca-32e1cd050eb0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:04:20.861366 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.861258    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a881115a-7418-48c2-a61f-7a1aff5f5058-kube-api-access-g62gq" (OuterVolumeSpecName: "kube-api-access-g62gq") pod "a881115a-7418-48c2-a61f-7a1aff5f5058" (UID: "a881115a-7418-48c2-a61f-7a1aff5f5058"). InnerVolumeSpecName "kube-api-access-g62gq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:04:20.960736 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.960653    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txblt\" (UniqueName: \"kubernetes.io/projected/4442b2c6-704b-4d7a-a35d-6cd302348489-kube-api-access-txblt\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:04:20.960736 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.960681    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh7jb\" (UniqueName: \"kubernetes.io/projected/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-kube-api-access-hh7jb\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:04:20.960736 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.960691    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4796ec6-aa9f-4569-81ca-32e1cd050eb0-maas-api-tls\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:04:20.960736 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:20.960700    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g62gq\" (UniqueName: \"kubernetes.io/projected/a881115a-7418-48c2-a61f-7a1aff5f5058-kube-api-access-g62gq\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:04:21.604893 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.604856    2580 generic.go:356] "Generic (PLEG): container finished" podID="a881115a-7418-48c2-a61f-7a1aff5f5058" containerID="780d6150e47bb60fb55abec5c45bceaf4d6b5f08a7481cc96b50a33aa8992709" exitCode=0
Jul 27 18:04:21.605365 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.604904    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"
Jul 27 18:04:21.605365 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.604944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw" event={"ID":"a881115a-7418-48c2-a61f-7a1aff5f5058","Type":"ContainerDied","Data":"780d6150e47bb60fb55abec5c45bceaf4d6b5f08a7481cc96b50a33aa8992709"}
Jul 27 18:04:21.605365 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.604997    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw" event={"ID":"a881115a-7418-48c2-a61f-7a1aff5f5058","Type":"ContainerDied","Data":"9934f1069bc8b55e7723057ea5d4b90d1c3f051cb1218cb05d8dad98aa894217"}
Jul 27 18:04:21.605365 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.605023    2580 scope.go:117] "RemoveContainer" containerID="780d6150e47bb60fb55abec5c45bceaf4d6b5f08a7481cc96b50a33aa8992709"
Jul 27 18:04:21.606561 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.606272    2580 generic.go:356] "Generic (PLEG): container finished" podID="4442b2c6-704b-4d7a-a35d-6cd302348489" containerID="50b66362c7b278cb38e6b2c01347223df494273ede7ef30bb8d34e5a04c53827" exitCode=0
Jul 27 18:04:21.606561 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.606319    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"
Jul 27 18:04:21.606561 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.606331    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq" event={"ID":"4442b2c6-704b-4d7a-a35d-6cd302348489","Type":"ContainerDied","Data":"50b66362c7b278cb38e6b2c01347223df494273ede7ef30bb8d34e5a04c53827"}
Jul 27 18:04:21.606561 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.606386    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq" event={"ID":"4442b2c6-704b-4d7a-a35d-6cd302348489","Type":"ContainerDied","Data":"8f1a6abb5868226f2f8c36c9e150cda41caed3a70c2bb17b7bb85fb85448e97e"}
Jul 27 18:04:21.608141 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.608120    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw" event={"ID":"c4796ec6-aa9f-4569-81ca-32e1cd050eb0","Type":"ContainerDied","Data":"5512d1b8486cd53e145839e416773208768b1ded8bd02240dc205267fe732c38"}
Jul 27 18:04:21.608267 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.608123    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"
Jul 27 18:04:21.614848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.614830    2580 scope.go:117] "RemoveContainer" containerID="780d6150e47bb60fb55abec5c45bceaf4d6b5f08a7481cc96b50a33aa8992709"
Jul 27 18:04:21.615113 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:04:21.615096    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"780d6150e47bb60fb55abec5c45bceaf4d6b5f08a7481cc96b50a33aa8992709\": container with ID starting with 780d6150e47bb60fb55abec5c45bceaf4d6b5f08a7481cc96b50a33aa8992709 not found: ID does not exist" containerID="780d6150e47bb60fb55abec5c45bceaf4d6b5f08a7481cc96b50a33aa8992709"
Jul 27 18:04:21.615163 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.615122    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"780d6150e47bb60fb55abec5c45bceaf4d6b5f08a7481cc96b50a33aa8992709"} err="failed to get container status \"780d6150e47bb60fb55abec5c45bceaf4d6b5f08a7481cc96b50a33aa8992709\": rpc error: code = NotFound desc = could not find container \"780d6150e47bb60fb55abec5c45bceaf4d6b5f08a7481cc96b50a33aa8992709\": container with ID starting with 780d6150e47bb60fb55abec5c45bceaf4d6b5f08a7481cc96b50a33aa8992709 not found: ID does not exist"
Jul 27 18:04:21.615163 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.615146    2580 scope.go:117] "RemoveContainer" containerID="50b66362c7b278cb38e6b2c01347223df494273ede7ef30bb8d34e5a04c53827"
Jul 27 18:04:21.623130 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.623006    2580 scope.go:117] "RemoveContainer" containerID="50b66362c7b278cb38e6b2c01347223df494273ede7ef30bb8d34e5a04c53827"
Jul 27 18:04:21.623300 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:04:21.623282    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50b66362c7b278cb38e6b2c01347223df494273ede7ef30bb8d34e5a04c53827\": container with ID starting with 50b66362c7b278cb38e6b2c01347223df494273ede7ef30bb8d34e5a04c53827 not found: ID does not exist" containerID="50b66362c7b278cb38e6b2c01347223df494273ede7ef30bb8d34e5a04c53827"
Jul 27 18:04:21.623357 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.623307    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50b66362c7b278cb38e6b2c01347223df494273ede7ef30bb8d34e5a04c53827"} err="failed to get container status \"50b66362c7b278cb38e6b2c01347223df494273ede7ef30bb8d34e5a04c53827\": rpc error: code = NotFound desc = could not find container \"50b66362c7b278cb38e6b2c01347223df494273ede7ef30bb8d34e5a04c53827\": container with ID starting with 50b66362c7b278cb38e6b2c01347223df494273ede7ef30bb8d34e5a04c53827 not found: ID does not exist"
Jul 27 18:04:21.623357 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.623324    2580 scope.go:117] "RemoveContainer" containerID="a88025c2038f1639740b387f1e9c26fec9bb341f4a1bb24e93e399e47e433197"
Jul 27 18:04:21.625198 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.625179    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"]
Jul 27 18:04:21.630959 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.630940    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-77a616d7-5458fd747b-58bhq"]
Jul 27 18:04:21.639946 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.639923    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"]
Jul 27 18:04:21.645444 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.645420    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-77a616d7-7cfd95f4b6-4qmxw"]
Jul 27 18:04:21.655797 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.655779    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"]
Jul 27 18:04:21.658070 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:21.658053    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77a616d7-b6977cbc8-hf7lw"]
Jul 27 18:04:23.476380 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:23.476347    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4442b2c6-704b-4d7a-a35d-6cd302348489" path="/var/lib/kubelet/pods/4442b2c6-704b-4d7a-a35d-6cd302348489/volumes"
Jul 27 18:04:23.476768 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:23.476741    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a881115a-7418-48c2-a61f-7a1aff5f5058" path="/var/lib/kubelet/pods/a881115a-7418-48c2-a61f-7a1aff5f5058/volumes"
Jul 27 18:04:23.477081 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:04:23.477068    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4796ec6-aa9f-4569-81ca-32e1cd050eb0" path="/var/lib/kubelet/pods/c4796ec6-aa9f-4569-81ca-32e1cd050eb0/volumes"
Jul 27 18:05:27.582183 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:27.582150    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"]
Jul 27 18:05:27.582657 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:27.582330    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw" podUID="8089deb8-cf32-42d7-aa56-f4293388d8dc" containerName="istio-proxy" containerID="cri-o://ccc70b5af96ed4d579718964e0706c1225cfce87fb8430ac194967762e6ec2bd" gracePeriod=30
Jul 27 18:05:32.832492 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:32.832463    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:05:32.966167 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:32.966134    2580 generic.go:356] "Generic (PLEG): container finished" podID="8089deb8-cf32-42d7-aa56-f4293388d8dc" containerID="ccc70b5af96ed4d579718964e0706c1225cfce87fb8430ac194967762e6ec2bd" exitCode=0
Jul 27 18:05:32.966352 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:32.966182    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"
Jul 27 18:05:32.966352 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:32.966220    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw" event={"ID":"8089deb8-cf32-42d7-aa56-f4293388d8dc","Type":"ContainerDied","Data":"ccc70b5af96ed4d579718964e0706c1225cfce87fb8430ac194967762e6ec2bd"}
Jul 27 18:05:32.966352 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:32.966276    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw" event={"ID":"8089deb8-cf32-42d7-aa56-f4293388d8dc","Type":"ContainerDied","Data":"df2d6a2f7fe21987028208864958808e36afe13e97b25de9336ff4f107e2d5fd"}
Jul 27 18:05:32.966352 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:32.966300    2580 scope.go:117] "RemoveContainer" containerID="ccc70b5af96ed4d579718964e0706c1225cfce87fb8430ac194967762e6ec2bd"
Jul 27 18:05:32.975028 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:32.975013    2580 scope.go:117] "RemoveContainer" containerID="65d5592ecda447b8b44b59ebdbbd0ce5074868e7f3dcaa3bf8a42b93dc732994"
Jul 27 18:05:32.982769 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:32.982753    2580 scope.go:117] "RemoveContainer" containerID="ccc70b5af96ed4d579718964e0706c1225cfce87fb8430ac194967762e6ec2bd"
Jul 27 18:05:32.983016 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:05:32.982993    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccc70b5af96ed4d579718964e0706c1225cfce87fb8430ac194967762e6ec2bd\": container with ID starting with ccc70b5af96ed4d579718964e0706c1225cfce87fb8430ac194967762e6ec2bd not found: ID does not exist" containerID="ccc70b5af96ed4d579718964e0706c1225cfce87fb8430ac194967762e6ec2bd"
Jul 27 18:05:32.983099 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:32.983028    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccc70b5af96ed4d579718964e0706c1225cfce87fb8430ac194967762e6ec2bd"} err="failed to get container status \"ccc70b5af96ed4d579718964e0706c1225cfce87fb8430ac194967762e6ec2bd\": rpc error: code = NotFound desc = could not find container \"ccc70b5af96ed4d579718964e0706c1225cfce87fb8430ac194967762e6ec2bd\": container with ID starting with ccc70b5af96ed4d579718964e0706c1225cfce87fb8430ac194967762e6ec2bd not found: ID does not exist"
Jul 27 18:05:32.983099 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:32.983052    2580 scope.go:117] "RemoveContainer" containerID="65d5592ecda447b8b44b59ebdbbd0ce5074868e7f3dcaa3bf8a42b93dc732994"
Jul 27 18:05:32.983308 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:05:32.983291    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65d5592ecda447b8b44b59ebdbbd0ce5074868e7f3dcaa3bf8a42b93dc732994\": container with ID starting with 65d5592ecda447b8b44b59ebdbbd0ce5074868e7f3dcaa3bf8a42b93dc732994 not found: ID does not exist" containerID="65d5592ecda447b8b44b59ebdbbd0ce5074868e7f3dcaa3bf8a42b93dc732994"
Jul 27 18:05:32.983355 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:32.983321    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d5592ecda447b8b44b59ebdbbd0ce5074868e7f3dcaa3bf8a42b93dc732994"} err="failed to get container status \"65d5592ecda447b8b44b59ebdbbd0ce5074868e7f3dcaa3bf8a42b93dc732994\": rpc error: code = NotFound desc = could not find container \"65d5592ecda447b8b44b59ebdbbd0ce5074868e7f3dcaa3bf8a42b93dc732994\": container with ID starting with 65d5592ecda447b8b44b59ebdbbd0ce5074868e7f3dcaa3bf8a42b93dc732994 not found: ID does not exist"
Jul 27 18:05:33.013663 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.013637    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-data\") pod \"8089deb8-cf32-42d7-aa56-f4293388d8dc\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") "
Jul 27 18:05:33.013776 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.013674    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-workload-certs\") pod \"8089deb8-cf32-42d7-aa56-f4293388d8dc\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") "
Jul 27 18:05:33.013776 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.013710    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-workload-socket\") pod \"8089deb8-cf32-42d7-aa56-f4293388d8dc\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") "
Jul 27 18:05:33.013776 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.013742    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-envoy\") pod \"8089deb8-cf32-42d7-aa56-f4293388d8dc\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") "
Jul 27 18:05:33.013776 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.013769    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-credential-socket\") pod \"8089deb8-cf32-42d7-aa56-f4293388d8dc\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") "
Jul 27 18:05:33.013989 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.013821    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-token\") pod \"8089deb8-cf32-42d7-aa56-f4293388d8dc\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") "
Jul 27 18:05:33.013989 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.013849    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-podinfo\") pod \"8089deb8-cf32-42d7-aa56-f4293388d8dc\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") "
Jul 27 18:05:33.013989 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.013921    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flrw7\" (UniqueName: \"kubernetes.io/projected/8089deb8-cf32-42d7-aa56-f4293388d8dc-kube-api-access-flrw7\") pod \"8089deb8-cf32-42d7-aa56-f4293388d8dc\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") "
Jul 27 18:05:33.013989 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.013954    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8089deb8-cf32-42d7-aa56-f4293388d8dc" (UID: "8089deb8-cf32-42d7-aa56-f4293388d8dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:05:33.014241 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.014043    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8089deb8-cf32-42d7-aa56-f4293388d8dc" (UID: "8089deb8-cf32-42d7-aa56-f4293388d8dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:05:33.014241 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.014062    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8089deb8-cf32-42d7-aa56-f4293388d8dc" (UID: "8089deb8-cf32-42d7-aa56-f4293388d8dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:05:33.014241 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.014111    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8089deb8-cf32-42d7-aa56-f4293388d8dc-istiod-ca-cert\") pod \"8089deb8-cf32-42d7-aa56-f4293388d8dc\" (UID: \"8089deb8-cf32-42d7-aa56-f4293388d8dc\") "
Jul 27 18:05:33.014521 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.014485    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:05:33.014521 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.014510    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:05:33.014667 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.014526    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:05:33.014667 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.014528    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8089deb8-cf32-42d7-aa56-f4293388d8dc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8089deb8-cf32-42d7-aa56-f4293388d8dc" (UID: "8089deb8-cf32-42d7-aa56-f4293388d8dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:05:33.014785 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.014731    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-data" (OuterVolumeSpecName: "istio-data") pod "8089deb8-cf32-42d7-aa56-f4293388d8dc" (UID: "8089deb8-cf32-42d7-aa56-f4293388d8dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:05:33.015907 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.015877    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8089deb8-cf32-42d7-aa56-f4293388d8dc" (UID: "8089deb8-cf32-42d7-aa56-f4293388d8dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:05:33.016072 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.016047    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8089deb8-cf32-42d7-aa56-f4293388d8dc-kube-api-access-flrw7" (OuterVolumeSpecName: "kube-api-access-flrw7") pod "8089deb8-cf32-42d7-aa56-f4293388d8dc" (UID: "8089deb8-cf32-42d7-aa56-f4293388d8dc"). InnerVolumeSpecName "kube-api-access-flrw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:05:33.016184 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.016076    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-token" (OuterVolumeSpecName: "istio-token") pod "8089deb8-cf32-42d7-aa56-f4293388d8dc" (UID: "8089deb8-cf32-42d7-aa56-f4293388d8dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:05:33.016184 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.016078    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8089deb8-cf32-42d7-aa56-f4293388d8dc" (UID: "8089deb8-cf32-42d7-aa56-f4293388d8dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 18:05:33.115256 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.115228    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flrw7\" (UniqueName: \"kubernetes.io/projected/8089deb8-cf32-42d7-aa56-f4293388d8dc-kube-api-access-flrw7\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:05:33.115256 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.115256    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8089deb8-cf32-42d7-aa56-f4293388d8dc-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:05:33.115431 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.115269    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:05:33.115431 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.115280    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:05:33.115431 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.115289    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:05:33.115431 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.115299    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8089deb8-cf32-42d7-aa56-f4293388d8dc-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:05:33.291310 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.291278    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"]
Jul 27 18:05:33.298505 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.298480    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-77a616d7-openshift-default-db5b5748d-2nfkw"]
Jul 27 18:05:33.482113 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:05:33.482075    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8089deb8-cf32-42d7-aa56-f4293388d8dc" path="/var/lib/kubelet/pods/8089deb8-cf32-42d7-aa56-f4293388d8dc/volumes"
Jul 27 18:06:33.712815 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.712783    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"]
Jul 27 18:06:33.713202 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713137    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a881115a-7418-48c2-a61f-7a1aff5f5058" containerName="payload-processing"
Jul 27 18:06:33.713202 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713148    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a881115a-7418-48c2-a61f-7a1aff5f5058" containerName="payload-processing"
Jul 27 18:06:33.713202 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713157    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8089deb8-cf32-42d7-aa56-f4293388d8dc" containerName="istio-proxy"
Jul 27 18:06:33.713202 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713164    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8089deb8-cf32-42d7-aa56-f4293388d8dc" containerName="istio-proxy"
Jul 27 18:06:33.713202 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713178    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faf63eac-cc01-4492-a13c-16ea05f0a9eb" containerName="istio-proxy"
Jul 27 18:06:33.713202 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713183    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="faf63eac-cc01-4492-a13c-16ea05f0a9eb" containerName="istio-proxy"
Jul 27 18:06:33.713202 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713200    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4442b2c6-704b-4d7a-a35d-6cd302348489" containerName="payload-pre-processing"
Jul 27 18:06:33.713202 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713205    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4442b2c6-704b-4d7a-a35d-6cd302348489" containerName="payload-pre-processing"
Jul 27 18:06:33.713454 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713213    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faf63eac-cc01-4492-a13c-16ea05f0a9eb" containerName="istio-proxy"
Jul 27 18:06:33.713454 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713218    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="faf63eac-cc01-4492-a13c-16ea05f0a9eb" containerName="istio-proxy"
Jul 27 18:06:33.713454 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713224    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4796ec6-aa9f-4569-81ca-32e1cd050eb0" containerName="maas-api"
Jul 27 18:06:33.713454 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713229    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4796ec6-aa9f-4569-81ca-32e1cd050eb0" containerName="maas-api"
Jul 27 18:06:33.713454 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713280    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a881115a-7418-48c2-a61f-7a1aff5f5058" containerName="payload-processing"
Jul 27 18:06:33.713454 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713288    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8089deb8-cf32-42d7-aa56-f4293388d8dc" containerName="istio-proxy"
Jul 27 18:06:33.713454 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713294    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="faf63eac-cc01-4492-a13c-16ea05f0a9eb" containerName="istio-proxy"
Jul 27 18:06:33.713454 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713299    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="faf63eac-cc01-4492-a13c-16ea05f0a9eb" containerName="istio-proxy"
Jul 27 18:06:33.713454 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713306    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4442b2c6-704b-4d7a-a35d-6cd302348489" containerName="payload-pre-processing"
Jul 27 18:06:33.713454 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713312    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4796ec6-aa9f-4569-81ca-32e1cd050eb0" containerName="maas-api"
Jul 27 18:06:33.713454 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.713318    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8089deb8-cf32-42d7-aa56-f4293388d8dc" containerName="istio-proxy"
Jul 27 18:06:33.716283 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.716263    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.719623 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.719569    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-3a1577-openshift-default-dockercfg-wl87z\""
Jul 27 18:06:33.729528 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.729503    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"]
Jul 27 18:06:33.816481 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.816448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-workload-socket\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.816739 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.816489    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-workload-certs\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.816739 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.816574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-envoy\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.816739 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.816672    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-data\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.816739 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.816700    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istiod-ca-cert\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.816739 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.816738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-token\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.817081 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.816774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-podinfo\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.817081 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.816865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx64p\" (UniqueName: \"kubernetes.io/projected/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-kube-api-access-kx64p\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.817081 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.816909    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-credential-socket\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.917848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.917820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-podinfo\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.918016 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.917867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx64p\" (UniqueName: \"kubernetes.io/projected/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-kube-api-access-kx64p\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.918016 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.917986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-credential-socket\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.918092 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.918032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-workload-socket\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.918092 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.918056    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-workload-certs\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.918175 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.918095    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-envoy\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.918175 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.918146    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-data\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.918259 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.918172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istiod-ca-cert\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.918259 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.918202    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-token\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.918410 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.918379    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-credential-socket\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.918531 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.918408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-workload-socket\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.918647 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.918623    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-data\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.918699 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.918677    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-workload-certs\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.918951 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.918931    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istiod-ca-cert\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.920257 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.920238    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-envoy\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.920353 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.920334    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-podinfo\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.926319 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.926297    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-token\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:33.926419 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:33.926399    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx64p\" (UniqueName: \"kubernetes.io/projected/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-kube-api-access-kx64p\") pod \"e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") " pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:34.026342 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:34.026270    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:34.167231 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:34.167208    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"]
Jul 27 18:06:34.168951 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:06:34.168928    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f0c28b2_eea4_4e1e_a81b_cc1a49d72950.slice/crio-9b777305df708aa73c32bf3c1217998d7c3eebd4ef2e87d923823e624640f86e WatchSource:0}: Error finding container 9b777305df708aa73c32bf3c1217998d7c3eebd4ef2e87d923823e624640f86e: Status 404 returned error can't find the container with id 9b777305df708aa73c32bf3c1217998d7c3eebd4ef2e87d923823e624640f86e
Jul 27 18:06:34.171519 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:34.171485    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:06:34.171621 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:34.171545    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:06:34.171621 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:34.171574    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:06:34.256020 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:34.255984    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9" event={"ID":"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950","Type":"ContainerStarted","Data":"8d68ea1ecfafab878cb384533f8f4de5605ff915a279216d8c388b7a3e80564d"}
Jul 27 18:06:34.256189 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:34.256046    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9" event={"ID":"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950","Type":"ContainerStarted","Data":"9b777305df708aa73c32bf3c1217998d7c3eebd4ef2e87d923823e624640f86e"}
Jul 27 18:06:34.280402 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:34.280303    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9" podStartSLOduration=1.280288463 podStartE2EDuration="1.280288463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:06:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:06:34.278373075 +0000 UTC m=+2537.293039513" watchObservedRunningTime="2026-07-27 18:06:34.280288463 +0000 UTC m=+2537.294954907"
Jul 27 18:06:35.027019 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:35.026980    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:35.031890 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:35.031868    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:35.260209 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:35.260176    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:35.260957 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:35.260937    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:36.499071 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:36.499035    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"]
Jul 27 18:06:36.499616 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:36.499569    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8089deb8-cf32-42d7-aa56-f4293388d8dc" containerName="istio-proxy"
Jul 27 18:06:36.499616 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:36.499607    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8089deb8-cf32-42d7-aa56-f4293388d8dc" containerName="istio-proxy"
Jul 27 18:06:36.502753 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:36.502732    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"
Jul 27 18:06:36.504845 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:36.504824    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-3a1577-serving-cert\""
Jul 27 18:06:36.512818 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:36.512789    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"]
Jul 27 18:06:36.542651 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:36.542621    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69903e00-257c-4193-a3ad-3fccc3ca8d40-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6\" (UID: \"69903e00-257c-4193-a3ad-3fccc3ca8d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"
Jul 27 18:06:36.542775 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:36.542659    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69903e00-257c-4193-a3ad-3fccc3ca8d40-maas-api-tls\") pod \"maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6\" (UID: \"69903e00-257c-4193-a3ad-3fccc3ca8d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"
Jul 27 18:06:36.542775 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:36.542695    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8jjk\" (UniqueName: \"kubernetes.io/projected/69903e00-257c-4193-a3ad-3fccc3ca8d40-kube-api-access-s8jjk\") pod \"maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6\" (UID: \"69903e00-257c-4193-a3ad-3fccc3ca8d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"
Jul 27 18:06:36.643455 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:36.643420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8jjk\" (UniqueName: \"kubernetes.io/projected/69903e00-257c-4193-a3ad-3fccc3ca8d40-kube-api-access-s8jjk\") pod \"maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6\" (UID: \"69903e00-257c-4193-a3ad-3fccc3ca8d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"
Jul 27 18:06:36.643650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:36.643559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69903e00-257c-4193-a3ad-3fccc3ca8d40-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6\" (UID: \"69903e00-257c-4193-a3ad-3fccc3ca8d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"
Jul 27 18:06:36.643650 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:36.643604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69903e00-257c-4193-a3ad-3fccc3ca8d40-maas-api-tls\") pod \"maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6\" (UID: \"69903e00-257c-4193-a3ad-3fccc3ca8d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"
Jul 27 18:06:36.643788 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:06:36.643714    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-serving-cert: secret "maas-api-e2e-inf-a-3a1577-serving-cert" not found
Jul 27 18:06:36.643788 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:06:36.643785    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69903e00-257c-4193-a3ad-3fccc3ca8d40-maas-api-tls podName:69903e00-257c-4193-a3ad-3fccc3ca8d40 nodeName:}" failed. No retries permitted until 2026-07-27 18:06:37.143764037 +0000 UTC m=+2540.158430477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/69903e00-257c-4193-a3ad-3fccc3ca8d40-maas-api-tls") pod "maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6" (UID: "69903e00-257c-4193-a3ad-3fccc3ca8d40") : secret "maas-api-e2e-inf-a-3a1577-serving-cert" not found
Jul 27 18:06:36.644165 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:36.644144    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69903e00-257c-4193-a3ad-3fccc3ca8d40-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6\" (UID: \"69903e00-257c-4193-a3ad-3fccc3ca8d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"
Jul 27 18:06:36.656354 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:36.656325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8jjk\" (UniqueName: \"kubernetes.io/projected/69903e00-257c-4193-a3ad-3fccc3ca8d40-kube-api-access-s8jjk\") pod \"maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6\" (UID: \"69903e00-257c-4193-a3ad-3fccc3ca8d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"
Jul 27 18:06:37.076077 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.076037    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"]
Jul 27 18:06:37.079692 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.079672    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"
Jul 27 18:06:37.082420 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.082400    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-3a1577-dockercfg-7z5fs\""
Jul 27 18:06:37.082689 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.082672    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-3a1577\""
Jul 27 18:06:37.089352 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.089328    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"]
Jul 27 18:06:37.114844 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.114823    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"]
Jul 27 18:06:37.118150 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.118132    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"
Jul 27 18:06:37.129037 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.129014    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"]
Jul 27 18:06:37.149727 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.149706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69903e00-257c-4193-a3ad-3fccc3ca8d40-maas-api-tls\") pod \"maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6\" (UID: \"69903e00-257c-4193-a3ad-3fccc3ca8d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"
Jul 27 18:06:37.149853 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.149780    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/513f3330-f4db-46f6-b943-fc3516f80d9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m\" (UID: \"513f3330-f4db-46f6-b943-fc3516f80d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"
Jul 27 18:06:37.149853 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.149821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8ckf\" (UniqueName: \"kubernetes.io/projected/788c4866-7089-4e89-8c09-bcd7231815f3-kube-api-access-b8ckf\") pod \"payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n\" (UID: \"788c4866-7089-4e89-8c09-bcd7231815f3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"
Jul 27 18:06:37.149962 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.149858    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhxh2\" (UniqueName: \"kubernetes.io/projected/513f3330-f4db-46f6-b943-fc3516f80d9f-kube-api-access-hhxh2\") pod \"payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m\" (UID: \"513f3330-f4db-46f6-b943-fc3516f80d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"
Jul 27 18:06:37.149962 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.149935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/788c4866-7089-4e89-8c09-bcd7231815f3-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n\" (UID: \"788c4866-7089-4e89-8c09-bcd7231815f3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"
Jul 27 18:06:37.152054 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.152034    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69903e00-257c-4193-a3ad-3fccc3ca8d40-maas-api-tls\") pod \"maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6\" (UID: \"69903e00-257c-4193-a3ad-3fccc3ca8d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"
Jul 27 18:06:37.250594 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.250551    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/788c4866-7089-4e89-8c09-bcd7231815f3-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n\" (UID: \"788c4866-7089-4e89-8c09-bcd7231815f3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"
Jul 27 18:06:37.250789 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.250732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/513f3330-f4db-46f6-b943-fc3516f80d9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m\" (UID: \"513f3330-f4db-46f6-b943-fc3516f80d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"
Jul 27 18:06:37.250789 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.250775    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8ckf\" (UniqueName: \"kubernetes.io/projected/788c4866-7089-4e89-8c09-bcd7231815f3-kube-api-access-b8ckf\") pod \"payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n\" (UID: \"788c4866-7089-4e89-8c09-bcd7231815f3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"
Jul 27 18:06:37.250912 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.250812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhxh2\" (UniqueName: \"kubernetes.io/projected/513f3330-f4db-46f6-b943-fc3516f80d9f-kube-api-access-hhxh2\") pod \"payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m\" (UID: \"513f3330-f4db-46f6-b943-fc3516f80d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"
Jul 27 18:06:37.251469 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.251441    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/788c4866-7089-4e89-8c09-bcd7231815f3-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n\" (UID: \"788c4866-7089-4e89-8c09-bcd7231815f3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"
Jul 27 18:06:37.251558 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.251494    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/513f3330-f4db-46f6-b943-fc3516f80d9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m\" (UID: \"513f3330-f4db-46f6-b943-fc3516f80d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"
Jul 27 18:06:37.259860 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.259836    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhxh2\" (UniqueName: \"kubernetes.io/projected/513f3330-f4db-46f6-b943-fc3516f80d9f-kube-api-access-hhxh2\") pod \"payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m\" (UID: \"513f3330-f4db-46f6-b943-fc3516f80d9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"
Jul 27 18:06:37.259951 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.259839    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8ckf\" (UniqueName: \"kubernetes.io/projected/788c4866-7089-4e89-8c09-bcd7231815f3-kube-api-access-b8ckf\") pod \"payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n\" (UID: \"788c4866-7089-4e89-8c09-bcd7231815f3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"
Jul 27 18:06:37.392776 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.392703    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"
Jul 27 18:06:37.417031 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.417006    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"
Jul 27 18:06:37.429074 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.429048    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"
Jul 27 18:06:37.598924 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.595738    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"]
Jul 27 18:06:37.602614 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.602592    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:06:37.764750 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.764728    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"]
Jul 27 18:06:37.766694 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:06:37.766667    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513f3330_f4db_46f6_b943_fc3516f80d9f.slice/crio-cdc06bdbac6573bad1797ef3fe8700aa62400b283e4732512c8140337669916c WatchSource:0}: Error finding container cdc06bdbac6573bad1797ef3fe8700aa62400b283e4732512c8140337669916c: Status 404 returned error can't find the container with id cdc06bdbac6573bad1797ef3fe8700aa62400b283e4732512c8140337669916c
Jul 27 18:06:37.821126 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:37.821102    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"]
Jul 27 18:06:37.822300 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:06:37.822278    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod788c4866_7089_4e89_8c09_bcd7231815f3.slice/crio-773963d0b6c35e2098c1f71c0280190ee8fb4e15990b3a161e6b4e300af6e6fb WatchSource:0}: Error finding container 773963d0b6c35e2098c1f71c0280190ee8fb4e15990b3a161e6b4e300af6e6fb: Status 404 returned error can't find the container with id 773963d0b6c35e2098c1f71c0280190ee8fb4e15990b3a161e6b4e300af6e6fb
Jul 27 18:06:38.277752 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:38.277707    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m" event={"ID":"513f3330-f4db-46f6-b943-fc3516f80d9f","Type":"ContainerStarted","Data":"3a5a9d797dc413770f0aae2251f75e963bf8439f2ee95414213498de041c4800"}
Jul 27 18:06:38.277972 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:38.277766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m" event={"ID":"513f3330-f4db-46f6-b943-fc3516f80d9f","Type":"ContainerStarted","Data":"cdc06bdbac6573bad1797ef3fe8700aa62400b283e4732512c8140337669916c"}
Jul 27 18:06:38.277972 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:38.277876    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"
Jul 27 18:06:38.279332 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:38.279304    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n" event={"ID":"788c4866-7089-4e89-8c09-bcd7231815f3","Type":"ContainerStarted","Data":"7abcabc6117056501df7ef3fd3d438dfcd52c004d113593d0f36d17cd7885806"}
Jul 27 18:06:38.279481 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:38.279352    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n" event={"ID":"788c4866-7089-4e89-8c09-bcd7231815f3","Type":"ContainerStarted","Data":"773963d0b6c35e2098c1f71c0280190ee8fb4e15990b3a161e6b4e300af6e6fb"}
Jul 27 18:06:38.279481 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:38.279415    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"
Jul 27 18:06:38.280490 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:38.280468    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6" event={"ID":"69903e00-257c-4193-a3ad-3fccc3ca8d40","Type":"ContainerStarted","Data":"74e73c96384e8a4d44eb64d799f5ca0f4d1d885c5e7a0fc1a577e44662b24112"}
Jul 27 18:06:38.295146 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:38.295102    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m" podStartSLOduration=1.295086861 podStartE2EDuration="1.295086861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:06:38.293515131 +0000 UTC m=+2541.308181574" watchObservedRunningTime="2026-07-27 18:06:38.295086861 +0000 UTC m=+2541.309753306"
Jul 27 18:06:38.310156 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:38.310092    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n" podStartSLOduration=1.310080885 podStartE2EDuration="1.310080885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:06:38.308614001 +0000 UTC m=+2541.323280465" watchObservedRunningTime="2026-07-27 18:06:38.310080885 +0000 UTC m=+2541.324747329"
Jul 27 18:06:39.287541 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:39.287493    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6" event={"ID":"69903e00-257c-4193-a3ad-3fccc3ca8d40","Type":"ContainerStarted","Data":"1081af02d3b0e5622256f07fcd4631eec80c07a775c487902a1cc9885e7a9c29"}
Jul 27 18:06:39.288041 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:39.287963    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"
Jul 27 18:06:39.305634 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:39.305576    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6" podStartSLOduration=2.598783993 podStartE2EDuration="3.305561238s" totalImagesPullingTime="706.777245ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:06:39.303727578 +0000 UTC m=+2542.318394025" watchObservedRunningTime="2026-07-27 18:06:39.305561238 +0000 UTC m=+2542.320227681"
Jul 27 18:06:41.437666 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.437634    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"]
Jul 27 18:06:41.441265 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.441242    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.443321 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.443298    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-36c68f-openshift-default-dockercfg-fh5ff\""
Jul 27 18:06:41.452917 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.452892    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"]
Jul 27 18:06:41.486175 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.486152    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65fa6f1d-f851-4eab-b63e-96689f34f546-istiod-ca-cert\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.486296 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.486204    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-envoy\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.486296 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.486219    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-data\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.486412 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.486395    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-credential-socket\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.486449 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.486420    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j7q6\" (UniqueName: \"kubernetes.io/projected/65fa6f1d-f851-4eab-b63e-96689f34f546-kube-api-access-2j7q6\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.486449 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.486439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-workload-certs\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.486534 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.486462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-podinfo\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.486534 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.486487    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-token\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.486534 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.486523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-workload-socket\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.587456 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.587420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-envoy\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.587456 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.587454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-data\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.587738 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.587508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-credential-socket\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.587738 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.587527    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j7q6\" (UniqueName: \"kubernetes.io/projected/65fa6f1d-f851-4eab-b63e-96689f34f546-kube-api-access-2j7q6\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.587738 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.587551    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-workload-certs\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.587738 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.587574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-podinfo\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.587738 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.587609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-token\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.587738 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.587674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-workload-socket\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.588032 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.587774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65fa6f1d-f851-4eab-b63e-96689f34f546-istiod-ca-cert\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.588032 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.587960    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-credential-socket\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.588032 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.588003    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-workload-certs\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.588177 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.588058    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-data\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.588235 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.588218    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-workload-socket\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.588531 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.588507    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65fa6f1d-f851-4eab-b63e-96689f34f546-istiod-ca-cert\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.589745 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.589721    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-envoy\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.590364 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.590344    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-podinfo\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.595079 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.595047    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-token\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.595210 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.595194    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j7q6\" (UniqueName: \"kubernetes.io/projected/65fa6f1d-f851-4eab-b63e-96689f34f546-kube-api-access-2j7q6\") pod \"e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") " pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.753537 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.753458    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:41.896173 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.896131    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"]
Jul 27 18:06:41.906475 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:06:41.906445    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65fa6f1d_f851_4eab_b63e_96689f34f546.slice/crio-33ccd455a5530706eeed3d22b1898664b45c383ca6f3280717170781343347b2 WatchSource:0}: Error finding container 33ccd455a5530706eeed3d22b1898664b45c383ca6f3280717170781343347b2: Status 404 returned error can't find the container with id 33ccd455a5530706eeed3d22b1898664b45c383ca6f3280717170781343347b2
Jul 27 18:06:41.908598 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.908550    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:06:41.908712 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.908662    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:06:41.908777 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:41.908707    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:06:42.303208 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:42.303172    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf" event={"ID":"65fa6f1d-f851-4eab-b63e-96689f34f546","Type":"ContainerStarted","Data":"dc0121f63c916a65750b177231c1d253d05121224d32d201c9be4740ac7d27ad"}
Jul 27 18:06:42.303383 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:42.303228    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf" event={"ID":"65fa6f1d-f851-4eab-b63e-96689f34f546","Type":"ContainerStarted","Data":"33ccd455a5530706eeed3d22b1898664b45c383ca6f3280717170781343347b2"}
Jul 27 18:06:42.325228 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:42.325183    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf" podStartSLOduration=1.325168565 podStartE2EDuration="1.325168565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:06:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:06:42.322270829 +0000 UTC m=+2545.336937277" watchObservedRunningTime="2026-07-27 18:06:42.325168565 +0000 UTC m=+2545.339835009"
Jul 27 18:06:42.754881 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:42.754844    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:42.764944 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:42.764906    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:43.308838 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:43.308802    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:43.309861 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:43.309839    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:06:45.052382 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:45.052332    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"]
Jul 27 18:06:45.061452 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:45.061411    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"
Jul 27 18:06:45.064978 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:45.064957    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-36c68f-dockercfg-lnttk\""
Jul 27 18:06:45.065365 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:45.065345    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-36c68f\""
Jul 27 18:06:45.071385 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:45.071364    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"]
Jul 27 18:06:45.122156 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:45.122132    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spt4z\" (UniqueName: \"kubernetes.io/projected/c3735832-ab71-451d-bc66-d063eb62413c-kube-api-access-spt4z\") pod \"payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q\" (UID: \"c3735832-ab71-451d-bc66-d063eb62413c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"
Jul 27 18:06:45.122297 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:45.122273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3735832-ab71-451d-bc66-d063eb62413c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q\" (UID: \"c3735832-ab71-451d-bc66-d063eb62413c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"
Jul 27 18:06:45.223238 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:45.223198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3735832-ab71-451d-bc66-d063eb62413c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q\" (UID: \"c3735832-ab71-451d-bc66-d063eb62413c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"
Jul 27 18:06:45.223411 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:45.223253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spt4z\" (UniqueName: \"kubernetes.io/projected/c3735832-ab71-451d-bc66-d063eb62413c-kube-api-access-spt4z\") pod \"payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q\" (UID: \"c3735832-ab71-451d-bc66-d063eb62413c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"
Jul 27 18:06:45.223945 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:45.223923    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3735832-ab71-451d-bc66-d063eb62413c-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q\" (UID: \"c3735832-ab71-451d-bc66-d063eb62413c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"
Jul 27 18:06:45.230664 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:45.230638    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spt4z\" (UniqueName: \"kubernetes.io/projected/c3735832-ab71-451d-bc66-d063eb62413c-kube-api-access-spt4z\") pod \"payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q\" (UID: \"c3735832-ab71-451d-bc66-d063eb62413c\") " pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"
Jul 27 18:06:45.376831 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:45.376751    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"
Jul 27 18:06:45.536537 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:45.536515    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"]
Jul 27 18:06:45.538332 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:06:45.538303    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3735832_ab71_451d_bc66_d063eb62413c.slice/crio-fa1474def8626e417ba976bceb7f8aa3249aebfcfabc1c3d7e83eafe6e80712a WatchSource:0}: Error finding container fa1474def8626e417ba976bceb7f8aa3249aebfcfabc1c3d7e83eafe6e80712a: Status 404 returned error can't find the container with id fa1474def8626e417ba976bceb7f8aa3249aebfcfabc1c3d7e83eafe6e80712a
Jul 27 18:06:46.302935 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:46.302904    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"
Jul 27 18:06:46.325954 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:46.325920    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q" event={"ID":"c3735832-ab71-451d-bc66-d063eb62413c","Type":"ContainerStarted","Data":"7ed50d93de0a945cb7221f0d42f34e38def6eb4ffa11db595fb5321b5ffec8db"}
Jul 27 18:06:46.326112 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:46.325981    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"
Jul 27 18:06:46.326112 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:46.326002    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q" event={"ID":"c3735832-ab71-451d-bc66-d063eb62413c","Type":"ContainerStarted","Data":"fa1474def8626e417ba976bceb7f8aa3249aebfcfabc1c3d7e83eafe6e80712a"}
Jul 27 18:06:49.289366 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:49.289333    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"
Jul 27 18:06:49.289872 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:49.289415    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"
Jul 27 18:06:49.307504 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:49.307459    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q" podStartSLOduration=4.307444577 podStartE2EDuration="4.307444577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:06:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:06:46.353513383 +0000 UTC m=+2549.368179828" watchObservedRunningTime="2026-07-27 18:06:49.307444577 +0000 UTC m=+2552.322111021"
Jul 27 18:06:50.262260 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:50.262219    2580 patch_prober.go:28] interesting pod/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 27 18:06:50.262477 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:50.262278    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9" podUID="2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 27 18:06:50.355939 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:50.355906    2580 generic.go:356] "Generic (PLEG): container finished" podID="2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" containerID="8d68ea1ecfafab878cb384533f8f4de5605ff915a279216d8c388b7a3e80564d" exitCode=0
Jul 27 18:06:50.356301 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:50.355978    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9" event={"ID":"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950","Type":"ContainerDied","Data":"8d68ea1ecfafab878cb384533f8f4de5605ff915a279216d8c388b7a3e80564d"}
Jul 27 18:06:50.356403 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:50.356386    2580 scope.go:117] "RemoveContainer" containerID="8d68ea1ecfafab878cb384533f8f4de5605ff915a279216d8c388b7a3e80564d"
Jul 27 18:06:50.357372 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:50.357345    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:06:50.357438 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:50.357408    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:06:50.357484 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:50.357439    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:06:51.366616 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:51.366543    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9" event={"ID":"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950","Type":"ContainerStarted","Data":"80eb4b2cb6bd0b018272433de337af296d1f48bcd9aecc9a5b697e99ebe27543"}
Jul 27 18:06:52.027039 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:52.026999    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:52.027222 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:52.027204    2580 patch_prober.go:28] interesting pod/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 27 18:06:52.027268 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:52.027249    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9" podUID="2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 27 18:06:53.026846 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:53.026802    2580 patch_prober.go:28] interesting pod/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 27 18:06:53.027272 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:53.026878    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9" podUID="2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 27 18:06:54.027267 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:54.027232    2580 patch_prober.go:28] interesting pod/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 27 18:06:54.027718 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:54.027291    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9" podUID="2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 27 18:06:55.026904 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:55.026861    2580 patch_prober.go:28] interesting pod/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 27 18:06:55.027173 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:55.026924    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9" podUID="2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 27 18:06:56.030931 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:56.030903    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:56.031263 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:56.031179    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:56.031838 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:56.031818    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:06:57.334640 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:57.334599    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"
Jul 27 18:06:58.861997 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:58.860453    2580 patch_prober.go:28] interesting pod/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": read tcp 10.132.0.2:54060->10.132.0.78:15021: read: connection reset by peer" start-of-body=
Jul 27 18:06:58.861997 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:58.860522    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf" podUID="65fa6f1d-f851-4eab-b63e-96689f34f546" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": read tcp 10.132.0.2:54060->10.132.0.78:15021: read: connection reset by peer"
Jul 27 18:06:59.416217 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:59.416186    2580 generic.go:356] "Generic (PLEG): container finished" podID="65fa6f1d-f851-4eab-b63e-96689f34f546" containerID="dc0121f63c916a65750b177231c1d253d05121224d32d201c9be4740ac7d27ad" exitCode=0
Jul 27 18:06:59.416403 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:59.416264    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf" event={"ID":"65fa6f1d-f851-4eab-b63e-96689f34f546","Type":"ContainerDied","Data":"dc0121f63c916a65750b177231c1d253d05121224d32d201c9be4740ac7d27ad"}
Jul 27 18:06:59.416664 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:59.416649    2580 scope.go:117] "RemoveContainer" containerID="dc0121f63c916a65750b177231c1d253d05121224d32d201c9be4740ac7d27ad"
Jul 27 18:06:59.417697 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:59.417668    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:06:59.417776 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:59.417761    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:06:59.417815 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:06:59.417801    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:07:00.422770 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:07:00.422736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf" event={"ID":"65fa6f1d-f851-4eab-b63e-96689f34f546","Type":"ContainerStarted","Data":"273e65bcd5c52b025eb577696b8269ce222c77127c030fa934321a32c6865456"}
Jul 27 18:07:00.754645 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:07:00.754425    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:07:00.754829 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:07:00.754749    2580 patch_prober.go:28] interesting pod/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 27 18:07:00.754829 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:07:00.754806    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf" podUID="65fa6f1d-f851-4eab-b63e-96689f34f546" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 27 18:07:01.754263 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:07:01.754224    2580 patch_prober.go:28] interesting pod/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 27 18:07:01.754899 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:07:01.754867    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf" podUID="65fa6f1d-f851-4eab-b63e-96689f34f546" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 27 18:07:02.754638 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:07:02.754170    2580 patch_prober.go:28] interesting pod/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 27 18:07:02.754638 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:07:02.754233    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf" podUID="65fa6f1d-f851-4eab-b63e-96689f34f546" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 27 18:07:03.754124 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:07:03.754086    2580 patch_prober.go:28] interesting pod/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 27 18:07:03.754330 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:07:03.754154    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf" podUID="65fa6f1d-f851-4eab-b63e-96689f34f546" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 27 18:07:04.757555 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:07:04.757526    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:07:04.758014 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:07:04.757817    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:07:04.758669 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:07:04.758650    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:08:35.060855 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.060817    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"]
Jul 27 18:08:35.061428 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.061042    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6" podUID="69903e00-257c-4193-a3ad-3fccc3ca8d40" containerName="maas-api" containerID="cri-o://1081af02d3b0e5622256f07fcd4631eec80c07a775c487902a1cc9885e7a9c29" gracePeriod=30
Jul 27 18:08:35.102832 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.102800    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"]
Jul 27 18:08:35.103045 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.103018    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n" podUID="788c4866-7089-4e89-8c09-bcd7231815f3" containerName="payload-processing" containerID="cri-o://7abcabc6117056501df7ef3fd3d438dfcd52c004d113593d0f36d17cd7885806" gracePeriod=30
Jul 27 18:08:35.112905 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.112878    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"]
Jul 27 18:08:35.113291 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.113242    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m" podUID="513f3330-f4db-46f6-b943-fc3516f80d9f" containerName="payload-pre-processing" containerID="cri-o://3a5a9d797dc413770f0aae2251f75e963bf8439f2ee95414213498de041c4800" gracePeriod=30
Jul 27 18:08:35.163771 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:08:35.163729    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513f3330_f4db_46f6_b943_fc3516f80d9f.slice/crio-3a5a9d797dc413770f0aae2251f75e963bf8439f2ee95414213498de041c4800.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513f3330_f4db_46f6_b943_fc3516f80d9f.slice/crio-conmon-3a5a9d797dc413770f0aae2251f75e963bf8439f2ee95414213498de041c4800.scope\": RecentStats: unable to find data in memory cache]"
Jul 27 18:08:35.386864 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.386838    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"
Jul 27 18:08:35.413110 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.413078    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"
Jul 27 18:08:35.418487 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.418466    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"
Jul 27 18:08:35.501671 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.501641    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8jjk\" (UniqueName: \"kubernetes.io/projected/69903e00-257c-4193-a3ad-3fccc3ca8d40-kube-api-access-s8jjk\") pod \"69903e00-257c-4193-a3ad-3fccc3ca8d40\" (UID: \"69903e00-257c-4193-a3ad-3fccc3ca8d40\") "
Jul 27 18:08:35.501833 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.501703    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69903e00-257c-4193-a3ad-3fccc3ca8d40-maas-api-tls\") pod \"69903e00-257c-4193-a3ad-3fccc3ca8d40\" (UID: \"69903e00-257c-4193-a3ad-3fccc3ca8d40\") "
Jul 27 18:08:35.501833 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.501766    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8ckf\" (UniqueName: \"kubernetes.io/projected/788c4866-7089-4e89-8c09-bcd7231815f3-kube-api-access-b8ckf\") pod \"788c4866-7089-4e89-8c09-bcd7231815f3\" (UID: \"788c4866-7089-4e89-8c09-bcd7231815f3\") "
Jul 27 18:08:35.501833 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.501797    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/788c4866-7089-4e89-8c09-bcd7231815f3-plugins-config-volume\") pod \"788c4866-7089-4e89-8c09-bcd7231815f3\" (UID: \"788c4866-7089-4e89-8c09-bcd7231815f3\") "
Jul 27 18:08:35.501988 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.501884    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/513f3330-f4db-46f6-b943-fc3516f80d9f-plugins-config-volume\") pod \"513f3330-f4db-46f6-b943-fc3516f80d9f\" (UID: \"513f3330-f4db-46f6-b943-fc3516f80d9f\") "
Jul 27 18:08:35.501988 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.501907    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhxh2\" (UniqueName: \"kubernetes.io/projected/513f3330-f4db-46f6-b943-fc3516f80d9f-kube-api-access-hhxh2\") pod \"513f3330-f4db-46f6-b943-fc3516f80d9f\" (UID: \"513f3330-f4db-46f6-b943-fc3516f80d9f\") "
Jul 27 18:08:35.501988 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.501955    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69903e00-257c-4193-a3ad-3fccc3ca8d40-openshift-service-ca\") pod \"69903e00-257c-4193-a3ad-3fccc3ca8d40\" (UID: \"69903e00-257c-4193-a3ad-3fccc3ca8d40\") "
Jul 27 18:08:35.502332 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.502299    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/788c4866-7089-4e89-8c09-bcd7231815f3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "788c4866-7089-4e89-8c09-bcd7231815f3" (UID: "788c4866-7089-4e89-8c09-bcd7231815f3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:08:35.502463 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.502336    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/513f3330-f4db-46f6-b943-fc3516f80d9f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "513f3330-f4db-46f6-b943-fc3516f80d9f" (UID: "513f3330-f4db-46f6-b943-fc3516f80d9f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:08:35.502463 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.502381    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69903e00-257c-4193-a3ad-3fccc3ca8d40-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "69903e00-257c-4193-a3ad-3fccc3ca8d40" (UID: "69903e00-257c-4193-a3ad-3fccc3ca8d40"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:08:35.503980 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.503950    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/513f3330-f4db-46f6-b943-fc3516f80d9f-kube-api-access-hhxh2" (OuterVolumeSpecName: "kube-api-access-hhxh2") pod "513f3330-f4db-46f6-b943-fc3516f80d9f" (UID: "513f3330-f4db-46f6-b943-fc3516f80d9f"). InnerVolumeSpecName "kube-api-access-hhxh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:08:35.503980 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.503963    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69903e00-257c-4193-a3ad-3fccc3ca8d40-kube-api-access-s8jjk" (OuterVolumeSpecName: "kube-api-access-s8jjk") pod "69903e00-257c-4193-a3ad-3fccc3ca8d40" (UID: "69903e00-257c-4193-a3ad-3fccc3ca8d40"). InnerVolumeSpecName "kube-api-access-s8jjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:08:35.504216 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.504202    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/788c4866-7089-4e89-8c09-bcd7231815f3-kube-api-access-b8ckf" (OuterVolumeSpecName: "kube-api-access-b8ckf") pod "788c4866-7089-4e89-8c09-bcd7231815f3" (UID: "788c4866-7089-4e89-8c09-bcd7231815f3"). InnerVolumeSpecName "kube-api-access-b8ckf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:08:35.504405 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.504386    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69903e00-257c-4193-a3ad-3fccc3ca8d40-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "69903e00-257c-4193-a3ad-3fccc3ca8d40" (UID: "69903e00-257c-4193-a3ad-3fccc3ca8d40"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:08:35.603702 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.603617    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8ckf\" (UniqueName: \"kubernetes.io/projected/788c4866-7089-4e89-8c09-bcd7231815f3-kube-api-access-b8ckf\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:35.603702 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.603647    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/788c4866-7089-4e89-8c09-bcd7231815f3-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:35.603702 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.603659    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/513f3330-f4db-46f6-b943-fc3516f80d9f-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:35.603702 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.603669    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhxh2\" (UniqueName: \"kubernetes.io/projected/513f3330-f4db-46f6-b943-fc3516f80d9f-kube-api-access-hhxh2\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:35.603702 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.603677    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69903e00-257c-4193-a3ad-3fccc3ca8d40-openshift-service-ca\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:35.603702 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.603686    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8jjk\" (UniqueName: \"kubernetes.io/projected/69903e00-257c-4193-a3ad-3fccc3ca8d40-kube-api-access-s8jjk\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:35.603702 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.603704    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69903e00-257c-4193-a3ad-3fccc3ca8d40-maas-api-tls\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:35.897202 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.897107    2580 generic.go:356] "Generic (PLEG): container finished" podID="513f3330-f4db-46f6-b943-fc3516f80d9f" containerID="3a5a9d797dc413770f0aae2251f75e963bf8439f2ee95414213498de041c4800" exitCode=0
Jul 27 18:08:35.897202 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.897151    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"
Jul 27 18:08:35.897202 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.897191    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m" event={"ID":"513f3330-f4db-46f6-b943-fc3516f80d9f","Type":"ContainerDied","Data":"3a5a9d797dc413770f0aae2251f75e963bf8439f2ee95414213498de041c4800"}
Jul 27 18:08:35.897484 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.897244    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m" event={"ID":"513f3330-f4db-46f6-b943-fc3516f80d9f","Type":"ContainerDied","Data":"cdc06bdbac6573bad1797ef3fe8700aa62400b283e4732512c8140337669916c"}
Jul 27 18:08:35.897484 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.897274    2580 scope.go:117] "RemoveContainer" containerID="3a5a9d797dc413770f0aae2251f75e963bf8439f2ee95414213498de041c4800"
Jul 27 18:08:35.898530 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.898509    2580 generic.go:356] "Generic (PLEG): container finished" podID="788c4866-7089-4e89-8c09-bcd7231815f3" containerID="7abcabc6117056501df7ef3fd3d438dfcd52c004d113593d0f36d17cd7885806" exitCode=0
Jul 27 18:08:35.898630 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.898556    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"
Jul 27 18:08:35.898630 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.898614    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n" event={"ID":"788c4866-7089-4e89-8c09-bcd7231815f3","Type":"ContainerDied","Data":"7abcabc6117056501df7ef3fd3d438dfcd52c004d113593d0f36d17cd7885806"}
Jul 27 18:08:35.898754 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.898667    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n" event={"ID":"788c4866-7089-4e89-8c09-bcd7231815f3","Type":"ContainerDied","Data":"773963d0b6c35e2098c1f71c0280190ee8fb4e15990b3a161e6b4e300af6e6fb"}
Jul 27 18:08:35.900113 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.900084    2580 generic.go:356] "Generic (PLEG): container finished" podID="69903e00-257c-4193-a3ad-3fccc3ca8d40" containerID="1081af02d3b0e5622256f07fcd4631eec80c07a775c487902a1cc9885e7a9c29" exitCode=0
Jul 27 18:08:35.900230 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.900123    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"
Jul 27 18:08:35.900230 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.900169    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6" event={"ID":"69903e00-257c-4193-a3ad-3fccc3ca8d40","Type":"ContainerDied","Data":"1081af02d3b0e5622256f07fcd4631eec80c07a775c487902a1cc9885e7a9c29"}
Jul 27 18:08:35.900230 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.900209    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6" event={"ID":"69903e00-257c-4193-a3ad-3fccc3ca8d40","Type":"ContainerDied","Data":"74e73c96384e8a4d44eb64d799f5ca0f4d1d885c5e7a0fc1a577e44662b24112"}
Jul 27 18:08:35.913899 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.913876    2580 scope.go:117] "RemoveContainer" containerID="3a5a9d797dc413770f0aae2251f75e963bf8439f2ee95414213498de041c4800"
Jul 27 18:08:35.914188 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:08:35.914164    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a5a9d797dc413770f0aae2251f75e963bf8439f2ee95414213498de041c4800\": container with ID starting with 3a5a9d797dc413770f0aae2251f75e963bf8439f2ee95414213498de041c4800 not found: ID does not exist" containerID="3a5a9d797dc413770f0aae2251f75e963bf8439f2ee95414213498de041c4800"
Jul 27 18:08:35.914257 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.914201    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a5a9d797dc413770f0aae2251f75e963bf8439f2ee95414213498de041c4800"} err="failed to get container status \"3a5a9d797dc413770f0aae2251f75e963bf8439f2ee95414213498de041c4800\": rpc error: code = NotFound desc = could not find container \"3a5a9d797dc413770f0aae2251f75e963bf8439f2ee95414213498de041c4800\": container with ID starting with 3a5a9d797dc413770f0aae2251f75e963bf8439f2ee95414213498de041c4800 not found: ID does not exist"
Jul 27 18:08:35.914257 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.914222    2580 scope.go:117] "RemoveContainer" containerID="7abcabc6117056501df7ef3fd3d438dfcd52c004d113593d0f36d17cd7885806"
Jul 27 18:08:35.922359 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.922339    2580 scope.go:117] "RemoveContainer" containerID="7abcabc6117056501df7ef3fd3d438dfcd52c004d113593d0f36d17cd7885806"
Jul 27 18:08:35.922604 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:08:35.922566    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7abcabc6117056501df7ef3fd3d438dfcd52c004d113593d0f36d17cd7885806\": container with ID starting with 7abcabc6117056501df7ef3fd3d438dfcd52c004d113593d0f36d17cd7885806 not found: ID does not exist" containerID="7abcabc6117056501df7ef3fd3d438dfcd52c004d113593d0f36d17cd7885806"
Jul 27 18:08:35.922661 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.922614    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7abcabc6117056501df7ef3fd3d438dfcd52c004d113593d0f36d17cd7885806"} err="failed to get container status \"7abcabc6117056501df7ef3fd3d438dfcd52c004d113593d0f36d17cd7885806\": rpc error: code = NotFound desc = could not find container \"7abcabc6117056501df7ef3fd3d438dfcd52c004d113593d0f36d17cd7885806\": container with ID starting with 7abcabc6117056501df7ef3fd3d438dfcd52c004d113593d0f36d17cd7885806 not found: ID does not exist"
Jul 27 18:08:35.922661 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.922635    2580 scope.go:117] "RemoveContainer" containerID="1081af02d3b0e5622256f07fcd4631eec80c07a775c487902a1cc9885e7a9c29"
Jul 27 18:08:35.927222 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.927201    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"]
Jul 27 18:08:35.931043 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.931027    2580 scope.go:117] "RemoveContainer" containerID="1081af02d3b0e5622256f07fcd4631eec80c07a775c487902a1cc9885e7a9c29"
Jul 27 18:08:35.931375 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:08:35.931351    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1081af02d3b0e5622256f07fcd4631eec80c07a775c487902a1cc9885e7a9c29\": container with ID starting with 1081af02d3b0e5622256f07fcd4631eec80c07a775c487902a1cc9885e7a9c29 not found: ID does not exist" containerID="1081af02d3b0e5622256f07fcd4631eec80c07a775c487902a1cc9885e7a9c29"
Jul 27 18:08:35.931472 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.931380    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1081af02d3b0e5622256f07fcd4631eec80c07a775c487902a1cc9885e7a9c29"} err="failed to get container status \"1081af02d3b0e5622256f07fcd4631eec80c07a775c487902a1cc9885e7a9c29\": rpc error: code = NotFound desc = could not find container \"1081af02d3b0e5622256f07fcd4631eec80c07a775c487902a1cc9885e7a9c29\": container with ID starting with 1081af02d3b0e5622256f07fcd4631eec80c07a775c487902a1cc9885e7a9c29 not found: ID does not exist"
Jul 27 18:08:35.932573 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.932554    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3a1577-56fb99fd9d-l7f7n"]
Jul 27 18:08:35.941042 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.941015    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"]
Jul 27 18:08:35.944993 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.944975    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3a1577-985758f84-p2f2m"]
Jul 27 18:08:35.954634 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.954612    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"]
Jul 27 18:08:35.958059 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:35.958038    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3a1577-7d788496c5-lntx6"]
Jul 27 18:08:37.476670 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:37.476635    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="513f3330-f4db-46f6-b943-fc3516f80d9f" path="/var/lib/kubelet/pods/513f3330-f4db-46f6-b943-fc3516f80d9f/volumes"
Jul 27 18:08:37.477184 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:37.477163    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69903e00-257c-4193-a3ad-3fccc3ca8d40" path="/var/lib/kubelet/pods/69903e00-257c-4193-a3ad-3fccc3ca8d40/volumes"
Jul 27 18:08:37.477524 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:37.477510    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="788c4866-7089-4e89-8c09-bcd7231815f3" path="/var/lib/kubelet/pods/788c4866-7089-4e89-8c09-bcd7231815f3/volumes"
Jul 27 18:08:46.144056 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:46.144020    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"]
Jul 27 18:08:46.144495 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:46.144290    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9" podUID="2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" containerName="istio-proxy" containerID="cri-o://80eb4b2cb6bd0b018272433de337af296d1f48bcd9aecc9a5b697e99ebe27543" gracePeriod=30
Jul 27 18:08:51.405639 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.405617    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:08:51.451572 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.451541    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-workload-socket\") pod \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") "
Jul 27 18:08:51.451572 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.451572    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istiod-ca-cert\") pod \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") "
Jul 27 18:08:51.451833 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.451631    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kx64p\" (UniqueName: \"kubernetes.io/projected/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-kube-api-access-kx64p\") pod \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") "
Jul 27 18:08:51.451833 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.451656    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-token\") pod \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") "
Jul 27 18:08:51.451833 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.451677    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-podinfo\") pod \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") "
Jul 27 18:08:51.451833 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.451706    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-credential-socket\") pod \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") "
Jul 27 18:08:51.451833 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.451782    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-workload-certs\") pod \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") "
Jul 27 18:08:51.452102 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.451828    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" (UID: "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:08:51.452102 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.452053    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" (UID: "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:08:51.452225 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.452123    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:51.452353 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.452320    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" (UID: "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:08:51.452452 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.452333    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" (UID: "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:08:51.453868 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.453837    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-token" (OuterVolumeSpecName: "istio-token") pod "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" (UID: "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:08:51.453999 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.453979    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" (UID: "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 18:08:51.454044 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.453980    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-kube-api-access-kx64p" (OuterVolumeSpecName: "kube-api-access-kx64p") pod "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" (UID: "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950"). InnerVolumeSpecName "kube-api-access-kx64p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:08:51.552829 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.552799    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-envoy\") pod \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") "
Jul 27 18:08:51.552829 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.552830    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-data\") pod \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\" (UID: \"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950\") "
Jul 27 18:08:51.553113 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.553093    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:51.553182 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.553120    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kx64p\" (UniqueName: \"kubernetes.io/projected/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-kube-api-access-kx64p\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:51.553182 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.553136    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:51.553182 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.553149    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:51.553182 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.553166    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:51.553182 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.553177    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:51.553715 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.553691    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-data" (OuterVolumeSpecName: "istio-data") pod "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" (UID: "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:08:51.554862 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.554842    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" (UID: "2f0c28b2-eea4-4e1e-a81b-cc1a49d72950"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:08:51.653576 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.653544    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:51.653576 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.653570    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:51.990020 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.989988    2580 generic.go:356] "Generic (PLEG): container finished" podID="2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" containerID="80eb4b2cb6bd0b018272433de337af296d1f48bcd9aecc9a5b697e99ebe27543" exitCode=0
Jul 27 18:08:51.990213 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.990037    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"
Jul 27 18:08:51.990213 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.990054    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9" event={"ID":"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950","Type":"ContainerDied","Data":"80eb4b2cb6bd0b018272433de337af296d1f48bcd9aecc9a5b697e99ebe27543"}
Jul 27 18:08:51.990213 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.990096    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9" event={"ID":"2f0c28b2-eea4-4e1e-a81b-cc1a49d72950","Type":"ContainerDied","Data":"9b777305df708aa73c32bf3c1217998d7c3eebd4ef2e87d923823e624640f86e"}
Jul 27 18:08:51.990213 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:51.990117    2580 scope.go:117] "RemoveContainer" containerID="80eb4b2cb6bd0b018272433de337af296d1f48bcd9aecc9a5b697e99ebe27543"
Jul 27 18:08:52.004680 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:52.004655    2580 scope.go:117] "RemoveContainer" containerID="8d68ea1ecfafab878cb384533f8f4de5605ff915a279216d8c388b7a3e80564d"
Jul 27 18:08:52.012773 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:52.012757    2580 scope.go:117] "RemoveContainer" containerID="80eb4b2cb6bd0b018272433de337af296d1f48bcd9aecc9a5b697e99ebe27543"
Jul 27 18:08:52.013039 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:08:52.013013    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80eb4b2cb6bd0b018272433de337af296d1f48bcd9aecc9a5b697e99ebe27543\": container with ID starting with 80eb4b2cb6bd0b018272433de337af296d1f48bcd9aecc9a5b697e99ebe27543 not found: ID does not exist" containerID="80eb4b2cb6bd0b018272433de337af296d1f48bcd9aecc9a5b697e99ebe27543"
Jul 27 18:08:52.013087 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:52.013061    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80eb4b2cb6bd0b018272433de337af296d1f48bcd9aecc9a5b697e99ebe27543"} err="failed to get container status \"80eb4b2cb6bd0b018272433de337af296d1f48bcd9aecc9a5b697e99ebe27543\": rpc error: code = NotFound desc = could not find container \"80eb4b2cb6bd0b018272433de337af296d1f48bcd9aecc9a5b697e99ebe27543\": container with ID starting with 80eb4b2cb6bd0b018272433de337af296d1f48bcd9aecc9a5b697e99ebe27543 not found: ID does not exist"
Jul 27 18:08:52.013132 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:52.013087    2580 scope.go:117] "RemoveContainer" containerID="8d68ea1ecfafab878cb384533f8f4de5605ff915a279216d8c388b7a3e80564d"
Jul 27 18:08:52.013392 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:08:52.013359    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d68ea1ecfafab878cb384533f8f4de5605ff915a279216d8c388b7a3e80564d\": container with ID starting with 8d68ea1ecfafab878cb384533f8f4de5605ff915a279216d8c388b7a3e80564d not found: ID does not exist" containerID="8d68ea1ecfafab878cb384533f8f4de5605ff915a279216d8c388b7a3e80564d"
Jul 27 18:08:52.013477 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:52.013399    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d68ea1ecfafab878cb384533f8f4de5605ff915a279216d8c388b7a3e80564d"} err="failed to get container status \"8d68ea1ecfafab878cb384533f8f4de5605ff915a279216d8c388b7a3e80564d\": rpc error: code = NotFound desc = could not find container \"8d68ea1ecfafab878cb384533f8f4de5605ff915a279216d8c388b7a3e80564d\": container with ID starting with 8d68ea1ecfafab878cb384533f8f4de5605ff915a279216d8c388b7a3e80564d not found: ID does not exist"
Jul 27 18:08:52.016350 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:52.016330    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"]
Jul 27 18:08:52.019410 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:52.019388    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-3a1577-openshift-default-6687c9b69d-952w9"]
Jul 27 18:08:53.476674 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:53.476643    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" path="/var/lib/kubelet/pods/2f0c28b2-eea4-4e1e-a81b-cc1a49d72950/volumes"
Jul 27 18:08:57.011664 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:57.011629    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"]
Jul 27 18:08:57.012150 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:57.011848    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q" podUID="c3735832-ab71-451d-bc66-d063eb62413c" containerName="payload-processing" containerID="cri-o://7ed50d93de0a945cb7221f0d42f34e38def6eb4ffa11db595fb5321b5ffec8db" gracePeriod=30
Jul 27 18:08:57.268514 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:57.268453    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"
Jul 27 18:08:57.293180 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:57.293154    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3735832-ab71-451d-bc66-d063eb62413c-plugins-config-volume\") pod \"c3735832-ab71-451d-bc66-d063eb62413c\" (UID: \"c3735832-ab71-451d-bc66-d063eb62413c\") "
Jul 27 18:08:57.293321 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:57.293199    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spt4z\" (UniqueName: \"kubernetes.io/projected/c3735832-ab71-451d-bc66-d063eb62413c-kube-api-access-spt4z\") pod \"c3735832-ab71-451d-bc66-d063eb62413c\" (UID: \"c3735832-ab71-451d-bc66-d063eb62413c\") "
Jul 27 18:08:57.299602 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:57.293822    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3735832-ab71-451d-bc66-d063eb62413c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c3735832-ab71-451d-bc66-d063eb62413c" (UID: "c3735832-ab71-451d-bc66-d063eb62413c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:08:57.299602 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:57.296178    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3735832-ab71-451d-bc66-d063eb62413c-kube-api-access-spt4z" (OuterVolumeSpecName: "kube-api-access-spt4z") pod "c3735832-ab71-451d-bc66-d063eb62413c" (UID: "c3735832-ab71-451d-bc66-d063eb62413c"). InnerVolumeSpecName "kube-api-access-spt4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:08:57.393783 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:57.393741    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3735832-ab71-451d-bc66-d063eb62413c-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:57.393783 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:57.393780    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spt4z\" (UniqueName: \"kubernetes.io/projected/c3735832-ab71-451d-bc66-d063eb62413c-kube-api-access-spt4z\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:08:58.023911 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:58.023877    2580 generic.go:356] "Generic (PLEG): container finished" podID="c3735832-ab71-451d-bc66-d063eb62413c" containerID="7ed50d93de0a945cb7221f0d42f34e38def6eb4ffa11db595fb5321b5ffec8db" exitCode=0
Jul 27 18:08:58.024327 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:58.023943    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"
Jul 27 18:08:58.024327 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:58.023963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q" event={"ID":"c3735832-ab71-451d-bc66-d063eb62413c","Type":"ContainerDied","Data":"7ed50d93de0a945cb7221f0d42f34e38def6eb4ffa11db595fb5321b5ffec8db"}
Jul 27 18:08:58.024327 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:58.024030    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q" event={"ID":"c3735832-ab71-451d-bc66-d063eb62413c","Type":"ContainerDied","Data":"fa1474def8626e417ba976bceb7f8aa3249aebfcfabc1c3d7e83eafe6e80712a"}
Jul 27 18:08:58.024327 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:58.024060    2580 scope.go:117] "RemoveContainer" containerID="7ed50d93de0a945cb7221f0d42f34e38def6eb4ffa11db595fb5321b5ffec8db"
Jul 27 18:08:58.032529 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:58.032513    2580 scope.go:117] "RemoveContainer" containerID="7ed50d93de0a945cb7221f0d42f34e38def6eb4ffa11db595fb5321b5ffec8db"
Jul 27 18:08:58.032786 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:08:58.032768    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed50d93de0a945cb7221f0d42f34e38def6eb4ffa11db595fb5321b5ffec8db\": container with ID starting with 7ed50d93de0a945cb7221f0d42f34e38def6eb4ffa11db595fb5321b5ffec8db not found: ID does not exist" containerID="7ed50d93de0a945cb7221f0d42f34e38def6eb4ffa11db595fb5321b5ffec8db"
Jul 27 18:08:58.032825 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:58.032794    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed50d93de0a945cb7221f0d42f34e38def6eb4ffa11db595fb5321b5ffec8db"} err="failed to get container status \"7ed50d93de0a945cb7221f0d42f34e38def6eb4ffa11db595fb5321b5ffec8db\": rpc error: code = NotFound desc = could not find container \"7ed50d93de0a945cb7221f0d42f34e38def6eb4ffa11db595fb5321b5ffec8db\": container with ID starting with 7ed50d93de0a945cb7221f0d42f34e38def6eb4ffa11db595fb5321b5ffec8db not found: ID does not exist"
Jul 27 18:08:58.040689 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:58.040669    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"]
Jul 27 18:08:58.045456 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:58.045433    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-36c68f-666cc5664d-xfp2q"]
Jul 27 18:08:59.476555 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:08:59.476522    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3735832-ab71-451d-bc66-d063eb62413c" path="/var/lib/kubelet/pods/c3735832-ab71-451d-bc66-d063eb62413c/volumes"
Jul 27 18:09:07.928109 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:07.928074    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"]
Jul 27 18:09:07.928684 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:07.928351    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf" podUID="65fa6f1d-f851-4eab-b63e-96689f34f546" containerName="istio-proxy" containerID="cri-o://273e65bcd5c52b025eb577696b8269ce222c77127c030fa934321a32c6865456" gracePeriod=30
Jul 27 18:09:08.875960 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.875917    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"]
Jul 27 18:09:08.876313 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876299    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69903e00-257c-4193-a3ad-3fccc3ca8d40" containerName="maas-api"
Jul 27 18:09:08.876364 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876316    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="69903e00-257c-4193-a3ad-3fccc3ca8d40" containerName="maas-api"
Jul 27 18:09:08.876364 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876329    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" containerName="istio-proxy"
Jul 27 18:09:08.876364 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876338    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" containerName="istio-proxy"
Jul 27 18:09:08.876364 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876360    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" containerName="istio-proxy"
Jul 27 18:09:08.876500 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876369    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" containerName="istio-proxy"
Jul 27 18:09:08.876500 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876380    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="788c4866-7089-4e89-8c09-bcd7231815f3" containerName="payload-processing"
Jul 27 18:09:08.876500 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876389    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="788c4866-7089-4e89-8c09-bcd7231815f3" containerName="payload-processing"
Jul 27 18:09:08.876500 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876402    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3735832-ab71-451d-bc66-d063eb62413c" containerName="payload-processing"
Jul 27 18:09:08.876500 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876410    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3735832-ab71-451d-bc66-d063eb62413c" containerName="payload-processing"
Jul 27 18:09:08.876500 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876430    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="513f3330-f4db-46f6-b943-fc3516f80d9f" containerName="payload-pre-processing"
Jul 27 18:09:08.876500 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876439    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="513f3330-f4db-46f6-b943-fc3516f80d9f" containerName="payload-pre-processing"
Jul 27 18:09:08.876737 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876543    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="788c4866-7089-4e89-8c09-bcd7231815f3" containerName="payload-processing"
Jul 27 18:09:08.876737 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876555    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="69903e00-257c-4193-a3ad-3fccc3ca8d40" containerName="maas-api"
Jul 27 18:09:08.876737 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876567    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3735832-ab71-451d-bc66-d063eb62413c" containerName="payload-processing"
Jul 27 18:09:08.876737 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876593    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" containerName="istio-proxy"
Jul 27 18:09:08.876737 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.876611    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="513f3330-f4db-46f6-b943-fc3516f80d9f" containerName="payload-pre-processing"
Jul 27 18:09:08.881012 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.880990    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:08.883085 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.883063    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-0a1799-openshift-default-dockercfg-ggd6d\""
Jul 27 18:09:08.891987 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.891965    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"]
Jul 27 18:09:08.987536 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.987486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-workload-certs\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:08.987536 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.987537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-envoy\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:08.988110 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.987675    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/744743bc-02cb-4b7d-bcae-4389bc9a0435-istiod-ca-cert\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:08.988110 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.987791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-data\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:08.988110 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.987826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-token\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:08.988110 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.987887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrqwx\" (UniqueName: \"kubernetes.io/projected/744743bc-02cb-4b7d-bcae-4389bc9a0435-kube-api-access-jrqwx\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:08.988110 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.987923    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-credential-socket\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:08.988110 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.987959    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-workload-socket\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:08.988110 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:08.987987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-podinfo\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.088825 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.088786    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/744743bc-02cb-4b7d-bcae-4389bc9a0435-istiod-ca-cert\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.089066 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.088876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-data\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.089066 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.088902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-token\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.089066 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.088929    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrqwx\" (UniqueName: \"kubernetes.io/projected/744743bc-02cb-4b7d-bcae-4389bc9a0435-kube-api-access-jrqwx\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.089066 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.088957    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-credential-socket\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.089066 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.088983    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-workload-socket\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.089066 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.089011    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-podinfo\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.089066 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.089064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-workload-certs\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.089469 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.089091    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-envoy\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.089469 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.089322    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-data\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.089469 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.089373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-workload-socket\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.089469 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.089427    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-credential-socket\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.089725 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.089642    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-workload-certs\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.089725 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.089648    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/744743bc-02cb-4b7d-bcae-4389bc9a0435-istiod-ca-cert\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.091924 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.091894    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-envoy\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.092111 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.092090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-podinfo\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.097122 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.097096    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-token\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.097283 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.097265    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrqwx\" (UniqueName: \"kubernetes.io/projected/744743bc-02cb-4b7d-bcae-4389bc9a0435-kube-api-access-jrqwx\") pod \"e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") " pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.191445 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.191413    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:09.346800 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.346672    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"]
Jul 27 18:09:09.349106 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:09:09.349075    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod744743bc_02cb_4b7d_bcae_4389bc9a0435.slice/crio-158cea9d86416e32a54101f171262bc3db1b3d120558502f26e647544cfd9b2d WatchSource:0}: Error finding container 158cea9d86416e32a54101f171262bc3db1b3d120558502f26e647544cfd9b2d: Status 404 returned error can't find the container with id 158cea9d86416e32a54101f171262bc3db1b3d120558502f26e647544cfd9b2d
Jul 27 18:09:09.351215 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.351181    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:09:09.351306 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.351264    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:09:09.351369 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:09.351311    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:09:10.091295 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:10.091214    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt" event={"ID":"744743bc-02cb-4b7d-bcae-4389bc9a0435","Type":"ContainerStarted","Data":"39449818d9ca5f9d72c621211ad73db09e88aabbd32b60c64734ba8fc2fff40e"}
Jul 27 18:09:10.091295 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:10.091268    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt" event={"ID":"744743bc-02cb-4b7d-bcae-4389bc9a0435","Type":"ContainerStarted","Data":"158cea9d86416e32a54101f171262bc3db1b3d120558502f26e647544cfd9b2d"}
Jul 27 18:09:10.112438 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:10.112379    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt" podStartSLOduration=2.112362905 podStartE2EDuration="2.112362905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:09:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:09:10.110567447 +0000 UTC m=+2693.125233890" watchObservedRunningTime="2026-07-27 18:09:10.112362905 +0000 UTC m=+2693.127029349"
Jul 27 18:09:10.192208 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:10.192179    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:10.196955 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:10.196930    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:11.097039 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:11.096996    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:11.098056 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:11.098032    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:12.682148 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.682114    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"]
Jul 27 18:09:12.682816 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.682795    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0c28b2-eea4-4e1e-a81b-cc1a49d72950" containerName="istio-proxy"
Jul 27 18:09:12.686033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.686009    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"
Jul 27 18:09:12.688277 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.688254    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-0a1799-dockercfg-rzk6k\""
Jul 27 18:09:12.688379 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.688315    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-0a1799\""
Jul 27 18:09:12.697154 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.697131    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"]
Jul 27 18:09:12.720222 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.720198    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"]
Jul 27 18:09:12.721946 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.721928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4gxp\" (UniqueName: \"kubernetes.io/projected/ef7999cd-e8dd-4b96-b6cd-086f688f3b71-kube-api-access-f4gxp\") pod \"payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt\" (UID: \"ef7999cd-e8dd-4b96-b6cd-086f688f3b71\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"
Jul 27 18:09:12.722008 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.721994    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef7999cd-e8dd-4b96-b6cd-086f688f3b71-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt\" (UID: \"ef7999cd-e8dd-4b96-b6cd-086f688f3b71\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"
Jul 27 18:09:12.723723 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.723707    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"
Jul 27 18:09:12.733145 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.733123    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"]
Jul 27 18:09:12.822971 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.822935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/312b9bb4-2b14-4f5d-a072-296e83ef533f-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn\" (UID: \"312b9bb4-2b14-4f5d-a072-296e83ef533f\") " pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"
Jul 27 18:09:12.822971 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.822973    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlcsc\" (UniqueName: \"kubernetes.io/projected/312b9bb4-2b14-4f5d-a072-296e83ef533f-kube-api-access-rlcsc\") pod \"payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn\" (UID: \"312b9bb4-2b14-4f5d-a072-296e83ef533f\") " pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"
Jul 27 18:09:12.823183 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.822999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef7999cd-e8dd-4b96-b6cd-086f688f3b71-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt\" (UID: \"ef7999cd-e8dd-4b96-b6cd-086f688f3b71\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"
Jul 27 18:09:12.823183 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.823142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4gxp\" (UniqueName: \"kubernetes.io/projected/ef7999cd-e8dd-4b96-b6cd-086f688f3b71-kube-api-access-f4gxp\") pod \"payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt\" (UID: \"ef7999cd-e8dd-4b96-b6cd-086f688f3b71\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"
Jul 27 18:09:12.823704 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.823687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef7999cd-e8dd-4b96-b6cd-086f688f3b71-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt\" (UID: \"ef7999cd-e8dd-4b96-b6cd-086f688f3b71\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"
Jul 27 18:09:12.832577 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.832552    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4gxp\" (UniqueName: \"kubernetes.io/projected/ef7999cd-e8dd-4b96-b6cd-086f688f3b71-kube-api-access-f4gxp\") pod \"payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt\" (UID: \"ef7999cd-e8dd-4b96-b6cd-086f688f3b71\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"
Jul 27 18:09:12.923844 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.923812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlcsc\" (UniqueName: \"kubernetes.io/projected/312b9bb4-2b14-4f5d-a072-296e83ef533f-kube-api-access-rlcsc\") pod \"payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn\" (UID: \"312b9bb4-2b14-4f5d-a072-296e83ef533f\") " pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"
Jul 27 18:09:12.923994 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.923928    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/312b9bb4-2b14-4f5d-a072-296e83ef533f-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn\" (UID: \"312b9bb4-2b14-4f5d-a072-296e83ef533f\") " pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"
Jul 27 18:09:12.924561 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.924542    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/312b9bb4-2b14-4f5d-a072-296e83ef533f-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn\" (UID: \"312b9bb4-2b14-4f5d-a072-296e83ef533f\") " pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"
Jul 27 18:09:12.932628 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.932566    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlcsc\" (UniqueName: \"kubernetes.io/projected/312b9bb4-2b14-4f5d-a072-296e83ef533f-kube-api-access-rlcsc\") pod \"payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn\" (UID: \"312b9bb4-2b14-4f5d-a072-296e83ef533f\") " pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"
Jul 27 18:09:12.997711 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:12.997687    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"
Jul 27 18:09:13.033907 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.033876    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"
Jul 27 18:09:13.114141 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.112214    2580 generic.go:356] "Generic (PLEG): container finished" podID="65fa6f1d-f851-4eab-b63e-96689f34f546" containerID="273e65bcd5c52b025eb577696b8269ce222c77127c030fa934321a32c6865456" exitCode=0
Jul 27 18:09:13.114141 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.113135    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf" event={"ID":"65fa6f1d-f851-4eab-b63e-96689f34f546","Type":"ContainerDied","Data":"273e65bcd5c52b025eb577696b8269ce222c77127c030fa934321a32c6865456"}
Jul 27 18:09:13.114141 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.113198    2580 scope.go:117] "RemoveContainer" containerID="dc0121f63c916a65750b177231c1d253d05121224d32d201c9be4740ac7d27ad"
Jul 27 18:09:13.227802 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.227773    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:09:13.328237 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.328199    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-data\") pod \"65fa6f1d-f851-4eab-b63e-96689f34f546\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") "
Jul 27 18:09:13.328388 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.328254    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-credential-socket\") pod \"65fa6f1d-f851-4eab-b63e-96689f34f546\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") "
Jul 27 18:09:13.328388 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.328308    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65fa6f1d-f851-4eab-b63e-96689f34f546-istiod-ca-cert\") pod \"65fa6f1d-f851-4eab-b63e-96689f34f546\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") "
Jul 27 18:09:13.328388 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.328325    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j7q6\" (UniqueName: \"kubernetes.io/projected/65fa6f1d-f851-4eab-b63e-96689f34f546-kube-api-access-2j7q6\") pod \"65fa6f1d-f851-4eab-b63e-96689f34f546\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") "
Jul 27 18:09:13.328388 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.328345    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-podinfo\") pod \"65fa6f1d-f851-4eab-b63e-96689f34f546\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") "
Jul 27 18:09:13.328388 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.328380    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-token\") pod \"65fa6f1d-f851-4eab-b63e-96689f34f546\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") "
Jul 27 18:09:13.328688 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.328534    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-workload-socket\") pod \"65fa6f1d-f851-4eab-b63e-96689f34f546\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") "
Jul 27 18:09:13.328688 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.328605    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-envoy\") pod \"65fa6f1d-f851-4eab-b63e-96689f34f546\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") "
Jul 27 18:09:13.328688 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.328656    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-workload-certs\") pod \"65fa6f1d-f851-4eab-b63e-96689f34f546\" (UID: \"65fa6f1d-f851-4eab-b63e-96689f34f546\") "
Jul 27 18:09:13.328849 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.328733    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65fa6f1d-f851-4eab-b63e-96689f34f546" (UID: "65fa6f1d-f851-4eab-b63e-96689f34f546"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:09:13.328849 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.328773    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65fa6f1d-f851-4eab-b63e-96689f34f546-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65fa6f1d-f851-4eab-b63e-96689f34f546" (UID: "65fa6f1d-f851-4eab-b63e-96689f34f546"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:09:13.328970 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.328950    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65fa6f1d-f851-4eab-b63e-96689f34f546" (UID: "65fa6f1d-f851-4eab-b63e-96689f34f546"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:09:13.329077 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.329024    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-data" (OuterVolumeSpecName: "istio-data") pod "65fa6f1d-f851-4eab-b63e-96689f34f546" (UID: "65fa6f1d-f851-4eab-b63e-96689f34f546"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:09:13.329214 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.329124    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:09:13.329214 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.329143    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:09:13.329214 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.329157    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:09:13.329214 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.329171    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65fa6f1d-f851-4eab-b63e-96689f34f546-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:09:13.329445 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.329248    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65fa6f1d-f851-4eab-b63e-96689f34f546" (UID: "65fa6f1d-f851-4eab-b63e-96689f34f546"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:09:13.330631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.330600    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65fa6f1d-f851-4eab-b63e-96689f34f546" (UID: "65fa6f1d-f851-4eab-b63e-96689f34f546"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 18:09:13.330733 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.330674    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65fa6f1d-f851-4eab-b63e-96689f34f546-kube-api-access-2j7q6" (OuterVolumeSpecName: "kube-api-access-2j7q6") pod "65fa6f1d-f851-4eab-b63e-96689f34f546" (UID: "65fa6f1d-f851-4eab-b63e-96689f34f546"). InnerVolumeSpecName "kube-api-access-2j7q6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:09:13.330733 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.330674    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-token" (OuterVolumeSpecName: "istio-token") pod "65fa6f1d-f851-4eab-b63e-96689f34f546" (UID: "65fa6f1d-f851-4eab-b63e-96689f34f546"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:09:13.330843 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.330827    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65fa6f1d-f851-4eab-b63e-96689f34f546" (UID: "65fa6f1d-f851-4eab-b63e-96689f34f546"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:09:13.371236 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.371210    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"]
Jul 27 18:09:13.371407 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:09:13.371385    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7999cd_e8dd_4b96_b6cd_086f688f3b71.slice/crio-0cf562afceaf944df1333bdaefa5339d077587664e715e494380a6ce4d61cf02 WatchSource:0}: Error finding container 0cf562afceaf944df1333bdaefa5339d077587664e715e494380a6ce4d61cf02: Status 404 returned error can't find the container with id 0cf562afceaf944df1333bdaefa5339d077587664e715e494380a6ce4d61cf02
Jul 27 18:09:13.427994 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.427969    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"]
Jul 27 18:09:13.430235 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:09:13.430210    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod312b9bb4_2b14_4f5d_a072_296e83ef533f.slice/crio-e8e5ebe7a4edb6790bb80f7454b1b800dc5184cf74834baade17c6985928e98d WatchSource:0}: Error finding container e8e5ebe7a4edb6790bb80f7454b1b800dc5184cf74834baade17c6985928e98d: Status 404 returned error can't find the container with id e8e5ebe7a4edb6790bb80f7454b1b800dc5184cf74834baade17c6985928e98d
Jul 27 18:09:13.430319 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.430302    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j7q6\" (UniqueName: \"kubernetes.io/projected/65fa6f1d-f851-4eab-b63e-96689f34f546-kube-api-access-2j7q6\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:09:13.430366 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.430327    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:09:13.430366 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.430338    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:09:13.430366 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.430348    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:09:13.430366 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:13.430357    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65fa6f1d-f851-4eab-b63e-96689f34f546-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:09:14.118971 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:14.118871    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt" event={"ID":"ef7999cd-e8dd-4b96-b6cd-086f688f3b71","Type":"ContainerStarted","Data":"cae44cf30f0a0c6cc6d2deccb43fc3d347bb8bef2fd3a52728232ba1f9b031f5"}
Jul 27 18:09:14.118971 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:14.118940    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt" event={"ID":"ef7999cd-e8dd-4b96-b6cd-086f688f3b71","Type":"ContainerStarted","Data":"0cf562afceaf944df1333bdaefa5339d077587664e715e494380a6ce4d61cf02"}
Jul 27 18:09:14.119459 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:14.119086    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"
Jul 27 18:09:14.120248 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:14.120223    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"
Jul 27 18:09:14.120248 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:14.120230    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf" event={"ID":"65fa6f1d-f851-4eab-b63e-96689f34f546","Type":"ContainerDied","Data":"33ccd455a5530706eeed3d22b1898664b45c383ca6f3280717170781343347b2"}
Jul 27 18:09:14.120436 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:14.120275    2580 scope.go:117] "RemoveContainer" containerID="273e65bcd5c52b025eb577696b8269ce222c77127c030fa934321a32c6865456"
Jul 27 18:09:14.122032 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:14.122004    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn" event={"ID":"312b9bb4-2b14-4f5d-a072-296e83ef533f","Type":"ContainerStarted","Data":"a39afa73693466ee12adf6250f726d3e97fc234a699ffdca2d509760bad0dc43"}
Jul 27 18:09:14.122135 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:14.122056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn" event={"ID":"312b9bb4-2b14-4f5d-a072-296e83ef533f","Type":"ContainerStarted","Data":"e8e5ebe7a4edb6790bb80f7454b1b800dc5184cf74834baade17c6985928e98d"}
Jul 27 18:09:14.122135 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:14.122123    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"
Jul 27 18:09:14.135302 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:14.135254    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt" podStartSLOduration=2.13523804 podStartE2EDuration="2.13523804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:09:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:09:14.133109287 +0000 UTC m=+2697.147775731" watchObservedRunningTime="2026-07-27 18:09:14.13523804 +0000 UTC m=+2697.149904485"
Jul 27 18:09:14.151125 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:14.151088    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn" podStartSLOduration=2.151075773 podStartE2EDuration="2.151075773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:09:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:09:14.14770381 +0000 UTC m=+2697.162370251" watchObservedRunningTime="2026-07-27 18:09:14.151075773 +0000 UTC m=+2697.165742216"
Jul 27 18:09:14.161353 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:14.161332    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"]
Jul 27 18:09:14.168197 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:14.168175    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-36c68f-openshift-default-6955774bd4-ffkcf"]
Jul 27 18:09:15.476707 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:15.476674    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65fa6f1d-f851-4eab-b63e-96689f34f546" path="/var/lib/kubelet/pods/65fa6f1d-f851-4eab-b63e-96689f34f546/volumes"
Jul 27 18:09:17.272685 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.272653    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"]
Jul 27 18:09:17.273156 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.273130    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65fa6f1d-f851-4eab-b63e-96689f34f546" containerName="istio-proxy"
Jul 27 18:09:17.273156 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.273154    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="65fa6f1d-f851-4eab-b63e-96689f34f546" containerName="istio-proxy"
Jul 27 18:09:17.273373 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.273270    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="65fa6f1d-f851-4eab-b63e-96689f34f546" containerName="istio-proxy"
Jul 27 18:09:17.273373 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.273279    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="65fa6f1d-f851-4eab-b63e-96689f34f546" containerName="istio-proxy"
Jul 27 18:09:17.277617 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.277576    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.279757 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.279732    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-47ce04-openshift-default-dockercfg-kg2c4\""
Jul 27 18:09:17.288192 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.288169    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"]
Jul 27 18:09:17.369260 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.369227    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-workload-socket\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.369434 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.369283    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-credential-socket\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.369434 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.369308    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-data\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.369434 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.369325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-token\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.369434 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.369344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-envoy\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.369599 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.369460    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istiod-ca-cert\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.369599 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.369519    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-workload-certs\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.369679 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.369636    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2fkt\" (UniqueName: \"kubernetes.io/projected/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-kube-api-access-b2fkt\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.369679 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.369674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-podinfo\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.471025 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.470993    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-credential-socket\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.471025 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.471024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-data\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.471286 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.471041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-token\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.471286 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.471059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-envoy\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.471286 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.471082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istiod-ca-cert\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.471286 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.471212    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-workload-certs\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.471517 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.471294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2fkt\" (UniqueName: \"kubernetes.io/projected/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-kube-api-access-b2fkt\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.471517 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.471331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-podinfo\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.471517 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.471355    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-workload-socket\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.471517 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.471427    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-data\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.471517 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.471469    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-credential-socket\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.471831 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.471667    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-workload-certs\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.471990 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.471964    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-workload-socket\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.472163 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.472146    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istiod-ca-cert\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.473870 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.473846    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-podinfo\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.473996 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.473852    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-envoy\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.477970 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.477944    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-token\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.478147 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.478130    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2fkt\" (UniqueName: \"kubernetes.io/projected/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-kube-api-access-b2fkt\") pod \"e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") " pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.591793 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.591710    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-47ce04-openshift-default-dockercfg-kg2c4\""
Jul 27 18:09:17.600344 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.600319    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:17.748929 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.748894    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"]
Jul 27 18:09:17.752227 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:09:17.752196    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode01baf2b_9572_4cfe_bc4a_d3389fd317ec.slice/crio-b8af2352175180e21c9cd085938800bb04a7a4a9640060b60b25b28516dfe05c WatchSource:0}: Error finding container b8af2352175180e21c9cd085938800bb04a7a4a9640060b60b25b28516dfe05c: Status 404 returned error can't find the container with id b8af2352175180e21c9cd085938800bb04a7a4a9640060b60b25b28516dfe05c
Jul 27 18:09:17.754510 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.754473    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:09:17.754620 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.754539    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:09:17.754620 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:17.754569    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:09:18.145477 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:18.145387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8" event={"ID":"e01baf2b-9572-4cfe-bc4a-d3389fd317ec","Type":"ContainerStarted","Data":"3b99d55dd2c708cec2c9abb6fdceecb272716cb459a9b4f4a5f76350af34b7f4"}
Jul 27 18:09:18.145477 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:18.145448    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8" event={"ID":"e01baf2b-9572-4cfe-bc4a-d3389fd317ec","Type":"ContainerStarted","Data":"b8af2352175180e21c9cd085938800bb04a7a4a9640060b60b25b28516dfe05c"}
Jul 27 18:09:18.165881 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:18.165831    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8" podStartSLOduration=1.165814815 podStartE2EDuration="1.165814815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:09:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:09:18.163322306 +0000 UTC m=+2701.177988750" watchObservedRunningTime="2026-07-27 18:09:18.165814815 +0000 UTC m=+2701.180481258"
Jul 27 18:09:18.600671 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:18.600634    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:18.605812 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:18.605787    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:19.152849 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:19.152812    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:19.159110 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:19.159085    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:20.876924 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:20.876873    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"]
Jul 27 18:09:20.877310 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:20.877293    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65fa6f1d-f851-4eab-b63e-96689f34f546" containerName="istio-proxy"
Jul 27 18:09:20.877310 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:20.877307    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="65fa6f1d-f851-4eab-b63e-96689f34f546" containerName="istio-proxy"
Jul 27 18:09:20.881976 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:20.881958    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"
Jul 27 18:09:20.884127 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:20.884107    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-47ce04\""
Jul 27 18:09:20.884224 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:20.884203    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-47ce04-dockercfg-btx4m\""
Jul 27 18:09:20.891212 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:20.891179    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"]
Jul 27 18:09:20.905257 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:20.905237    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"]
Jul 27 18:09:20.908813 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:20.908795    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"
Jul 27 18:09:20.917724 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:20.917700    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"]
Jul 27 18:09:21.004755 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:21.004710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85eddeeb-db72-49a0-9b59-fc2823fadb29-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7\" (UID: \"85eddeeb-db72-49a0-9b59-fc2823fadb29\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"
Jul 27 18:09:21.004919 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:21.004841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqtnv\" (UniqueName: \"kubernetes.io/projected/41ceb886-b3f6-4e58-a361-6b988a77ecd2-kube-api-access-nqtnv\") pod \"payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm\" (UID: \"41ceb886-b3f6-4e58-a361-6b988a77ecd2\") " pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"
Jul 27 18:09:21.004995 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:21.004978    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt62d\" (UniqueName: \"kubernetes.io/projected/85eddeeb-db72-49a0-9b59-fc2823fadb29-kube-api-access-xt62d\") pod \"payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7\" (UID: \"85eddeeb-db72-49a0-9b59-fc2823fadb29\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"
Jul 27 18:09:21.005057 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:21.005005    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41ceb886-b3f6-4e58-a361-6b988a77ecd2-plugins-config-volume\") pod \"payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm\" (UID: \"41ceb886-b3f6-4e58-a361-6b988a77ecd2\") " pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"
Jul 27 18:09:21.106016 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:21.105983    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt62d\" (UniqueName: \"kubernetes.io/projected/85eddeeb-db72-49a0-9b59-fc2823fadb29-kube-api-access-xt62d\") pod \"payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7\" (UID: \"85eddeeb-db72-49a0-9b59-fc2823fadb29\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"
Jul 27 18:09:21.106016 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:21.106016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41ceb886-b3f6-4e58-a361-6b988a77ecd2-plugins-config-volume\") pod \"payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm\" (UID: \"41ceb886-b3f6-4e58-a361-6b988a77ecd2\") " pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"
Jul 27 18:09:21.106264 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:21.106040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85eddeeb-db72-49a0-9b59-fc2823fadb29-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7\" (UID: \"85eddeeb-db72-49a0-9b59-fc2823fadb29\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"
Jul 27 18:09:21.106264 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:21.106084    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqtnv\" (UniqueName: \"kubernetes.io/projected/41ceb886-b3f6-4e58-a361-6b988a77ecd2-kube-api-access-nqtnv\") pod \"payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm\" (UID: \"41ceb886-b3f6-4e58-a361-6b988a77ecd2\") " pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"
Jul 27 18:09:21.106847 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:21.106821    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41ceb886-b3f6-4e58-a361-6b988a77ecd2-plugins-config-volume\") pod \"payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm\" (UID: \"41ceb886-b3f6-4e58-a361-6b988a77ecd2\") " pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"
Jul 27 18:09:21.107041 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:21.107018    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85eddeeb-db72-49a0-9b59-fc2823fadb29-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7\" (UID: \"85eddeeb-db72-49a0-9b59-fc2823fadb29\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"
Jul 27 18:09:21.119081 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:21.119055    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt62d\" (UniqueName: \"kubernetes.io/projected/85eddeeb-db72-49a0-9b59-fc2823fadb29-kube-api-access-xt62d\") pod \"payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7\" (UID: \"85eddeeb-db72-49a0-9b59-fc2823fadb29\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"
Jul 27 18:09:21.127017 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:21.126957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqtnv\" (UniqueName: \"kubernetes.io/projected/41ceb886-b3f6-4e58-a361-6b988a77ecd2-kube-api-access-nqtnv\") pod \"payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm\" (UID: \"41ceb886-b3f6-4e58-a361-6b988a77ecd2\") " pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"
Jul 27 18:09:21.193926 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:21.193886    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"
Jul 27 18:09:21.219149 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:21.219126    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"
Jul 27 18:09:21.399547 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:21.399506    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"]
Jul 27 18:09:21.401699 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:09:21.401668    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85eddeeb_db72_49a0_9b59_fc2823fadb29.slice/crio-73d5d2e1356cee14a214e224bec37f3f333365d484d36c61cf405fe115a564bf WatchSource:0}: Error finding container 73d5d2e1356cee14a214e224bec37f3f333365d484d36c61cf405fe115a564bf: Status 404 returned error can't find the container with id 73d5d2e1356cee14a214e224bec37f3f333365d484d36c61cf405fe115a564bf
Jul 27 18:09:21.429984 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:21.429956    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"]
Jul 27 18:09:21.435602 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:09:21.435561    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41ceb886_b3f6_4e58_a361_6b988a77ecd2.slice/crio-37619abebdd6f4f0ec42b46c70e893ab4cb36b69e91486224ac088a1dbfe3f21 WatchSource:0}: Error finding container 37619abebdd6f4f0ec42b46c70e893ab4cb36b69e91486224ac088a1dbfe3f21: Status 404 returned error can't find the container with id 37619abebdd6f4f0ec42b46c70e893ab4cb36b69e91486224ac088a1dbfe3f21
Jul 27 18:09:22.179337 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:22.179294    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm" event={"ID":"41ceb886-b3f6-4e58-a361-6b988a77ecd2","Type":"ContainerStarted","Data":"a11fc81d79ebcad08188dd45b7e7e821981a2a10c80685fcdd130a329ef1c319"}
Jul 27 18:09:22.179862 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:22.179413    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm" event={"ID":"41ceb886-b3f6-4e58-a361-6b988a77ecd2","Type":"ContainerStarted","Data":"37619abebdd6f4f0ec42b46c70e893ab4cb36b69e91486224ac088a1dbfe3f21"}
Jul 27 18:09:22.179862 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:22.179462    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"
Jul 27 18:09:22.181366 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:22.181333    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7" event={"ID":"85eddeeb-db72-49a0-9b59-fc2823fadb29","Type":"ContainerStarted","Data":"01c203937fbd65b160c81a8b405d951f9bb608d851fa9ec1dcd226159b840c45"}
Jul 27 18:09:22.181493 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:22.181399    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"
Jul 27 18:09:22.181493 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:22.181419    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7" event={"ID":"85eddeeb-db72-49a0-9b59-fc2823fadb29","Type":"ContainerStarted","Data":"73d5d2e1356cee14a214e224bec37f3f333365d484d36c61cf405fe115a564bf"}
Jul 27 18:09:22.197562 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:22.197512    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm" podStartSLOduration=2.197499658 podStartE2EDuration="2.197499658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:09:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:09:22.194258627 +0000 UTC m=+2705.208925070" watchObservedRunningTime="2026-07-27 18:09:22.197499658 +0000 UTC m=+2705.212166102"
Jul 27 18:09:22.208529 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:22.208489    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7" podStartSLOduration=2.20847653 podStartE2EDuration="2.20847653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:09:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:09:22.207599505 +0000 UTC m=+2705.222265969" watchObservedRunningTime="2026-07-27 18:09:22.20847653 +0000 UTC m=+2705.223142973"
Jul 27 18:09:25.130351 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:25.130298    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt" podUID="ef7999cd-e8dd-4b96-b6cd-086f688f3b71" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.81:9004: connect: connection refused"
Jul 27 18:09:25.130875 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:25.130854    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"
Jul 27 18:09:26.098345 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:26.098310    2580 patch_prober.go:28] interesting pod/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 27 18:09:26.098521 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:26.098364    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt" podUID="744743bc-02cb-4b7d-bcae-4389bc9a0435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 27 18:09:26.211294 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:26.211210    2580 generic.go:356] "Generic (PLEG): container finished" podID="744743bc-02cb-4b7d-bcae-4389bc9a0435" containerID="39449818d9ca5f9d72c621211ad73db09e88aabbd32b60c64734ba8fc2fff40e" exitCode=0
Jul 27 18:09:26.211294 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:26.211253    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt" event={"ID":"744743bc-02cb-4b7d-bcae-4389bc9a0435","Type":"ContainerDied","Data":"39449818d9ca5f9d72c621211ad73db09e88aabbd32b60c64734ba8fc2fff40e"}
Jul 27 18:09:26.211732 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:26.211662    2580 scope.go:117] "RemoveContainer" containerID="39449818d9ca5f9d72c621211ad73db09e88aabbd32b60c64734ba8fc2fff40e"
Jul 27 18:09:26.212719 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:26.212686    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:09:26.212837 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:26.212775    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:09:26.212906 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:26.212830    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:09:27.219886 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:27.219847    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt" event={"ID":"744743bc-02cb-4b7d-bcae-4389bc9a0435","Type":"ContainerStarted","Data":"8e8f0b5e1fa19b5fb2f15470d74f86fc85e704d50325f165249b28149d1728f0"}
Jul 27 18:09:28.198006 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:28.197974    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:28.198352 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:28.198330    2580 patch_prober.go:28] interesting pod/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 27 18:09:28.198514 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:28.198485    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt" podUID="744743bc-02cb-4b7d-bcae-4389bc9a0435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 27 18:09:29.191987 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:29.191947    2580 patch_prober.go:28] interesting pod/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 27 18:09:29.192377 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:29.192011    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt" podUID="744743bc-02cb-4b7d-bcae-4389bc9a0435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 27 18:09:30.192780 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:30.192737    2580 patch_prober.go:28] interesting pod/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 27 18:09:30.193172 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:30.192812    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt" podUID="744743bc-02cb-4b7d-bcae-4389bc9a0435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 27 18:09:31.220275 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:31.220242    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:31.220765 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:31.220685    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:31.221574 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:31.221552    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:09:32.247621 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:32.247561    2580 generic.go:356] "Generic (PLEG): container finished" podID="e01baf2b-9572-4cfe-bc4a-d3389fd317ec" containerID="3b99d55dd2c708cec2c9abb6fdceecb272716cb459a9b4f4a5f76350af34b7f4" exitCode=0
Jul 27 18:09:32.248078 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:32.247642    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8" event={"ID":"e01baf2b-9572-4cfe-bc4a-d3389fd317ec","Type":"ContainerDied","Data":"3b99d55dd2c708cec2c9abb6fdceecb272716cb459a9b4f4a5f76350af34b7f4"}
Jul 27 18:09:32.248163 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:32.248148    2580 scope.go:117] "RemoveContainer" containerID="3b99d55dd2c708cec2c9abb6fdceecb272716cb459a9b4f4a5f76350af34b7f4"
Jul 27 18:09:32.249079 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:32.249052    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:09:32.249231 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:32.249119    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:09:32.249231 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:32.249153    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:09:33.194769 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:33.194736    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"
Jul 27 18:09:33.194947 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:33.194813    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"
Jul 27 18:09:33.255048 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:33.255007    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8" event={"ID":"e01baf2b-9572-4cfe-bc4a-d3389fd317ec","Type":"ContainerStarted","Data":"6bd31b72b09e52c22be1f3b470050f5553efeeb5138aa4417894420813f94447"}
Jul 27 18:09:33.601488 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:33.601407    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:33.602407 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:33.602381    2580 patch_prober.go:28] interesting pod/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 27 18:09:33.602506 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:33.602435    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8" podUID="e01baf2b-9572-4cfe-bc4a-d3389fd317ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 27 18:09:34.152761 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:34.152729    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:34.601401 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:34.601363    2580 patch_prober.go:28] interesting pod/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 27 18:09:34.601855 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:34.601419    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8" podUID="e01baf2b-9572-4cfe-bc4a-d3389fd317ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 27 18:09:35.132242 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:35.132205    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"
Jul 27 18:09:35.600781 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:35.600748    2580 patch_prober.go:28] interesting pod/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 27 18:09:35.600967 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:35.600805    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8" podUID="e01baf2b-9572-4cfe-bc4a-d3389fd317ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 27 18:09:36.600818 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:36.600783    2580 patch_prober.go:28] interesting pod/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 27 18:09:36.601315 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:36.600847    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8" podUID="e01baf2b-9572-4cfe-bc4a-d3389fd317ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 27 18:09:37.601286 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:37.601249    2580 patch_prober.go:28] interesting pod/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 27 18:09:37.601708 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:37.601319    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8" podUID="e01baf2b-9572-4cfe-bc4a-d3389fd317ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 27 18:09:38.605317 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:38.605284    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:38.606405 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:38.606379    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:09:48.174712 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.174669    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"]
Jul 27 18:09:48.175290 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.174948    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn" podUID="312b9bb4-2b14-4f5d-a072-296e83ef533f" containerName="payload-processing" containerID="cri-o://a39afa73693466ee12adf6250f726d3e97fc234a699ffdca2d509760bad0dc43" gracePeriod=30
Jul 27 18:09:48.182667 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.182634    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"]
Jul 27 18:09:48.182888 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.182858    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt" podUID="ef7999cd-e8dd-4b96-b6cd-086f688f3b71" containerName="payload-pre-processing" containerID="cri-o://cae44cf30f0a0c6cc6d2deccb43fc3d347bb8bef2fd3a52728232ba1f9b031f5" gracePeriod=30
Jul 27 18:09:48.346807 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.344446    2580 generic.go:356] "Generic (PLEG): container finished" podID="312b9bb4-2b14-4f5d-a072-296e83ef533f" containerID="a39afa73693466ee12adf6250f726d3e97fc234a699ffdca2d509760bad0dc43" exitCode=0
Jul 27 18:09:48.346807 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.344556    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn" event={"ID":"312b9bb4-2b14-4f5d-a072-296e83ef533f","Type":"ContainerDied","Data":"a39afa73693466ee12adf6250f726d3e97fc234a699ffdca2d509760bad0dc43"}
Jul 27 18:09:48.346807 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.346488    2580 generic.go:356] "Generic (PLEG): container finished" podID="ef7999cd-e8dd-4b96-b6cd-086f688f3b71" containerID="cae44cf30f0a0c6cc6d2deccb43fc3d347bb8bef2fd3a52728232ba1f9b031f5" exitCode=0
Jul 27 18:09:48.346807 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.346629    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt" event={"ID":"ef7999cd-e8dd-4b96-b6cd-086f688f3b71","Type":"ContainerDied","Data":"cae44cf30f0a0c6cc6d2deccb43fc3d347bb8bef2fd3a52728232ba1f9b031f5"}
Jul 27 18:09:48.469178 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.469153    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"
Jul 27 18:09:48.472313 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.472289    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"
Jul 27 18:09:48.494461 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.494435    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/312b9bb4-2b14-4f5d-a072-296e83ef533f-plugins-config-volume\") pod \"312b9bb4-2b14-4f5d-a072-296e83ef533f\" (UID: \"312b9bb4-2b14-4f5d-a072-296e83ef533f\") "
Jul 27 18:09:48.494613 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.494516    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlcsc\" (UniqueName: \"kubernetes.io/projected/312b9bb4-2b14-4f5d-a072-296e83ef533f-kube-api-access-rlcsc\") pod \"312b9bb4-2b14-4f5d-a072-296e83ef533f\" (UID: \"312b9bb4-2b14-4f5d-a072-296e83ef533f\") "
Jul 27 18:09:48.494613 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.494552    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef7999cd-e8dd-4b96-b6cd-086f688f3b71-plugins-config-volume\") pod \"ef7999cd-e8dd-4b96-b6cd-086f688f3b71\" (UID: \"ef7999cd-e8dd-4b96-b6cd-086f688f3b71\") "
Jul 27 18:09:48.494613 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.494605    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4gxp\" (UniqueName: \"kubernetes.io/projected/ef7999cd-e8dd-4b96-b6cd-086f688f3b71-kube-api-access-f4gxp\") pod \"ef7999cd-e8dd-4b96-b6cd-086f688f3b71\" (UID: \"ef7999cd-e8dd-4b96-b6cd-086f688f3b71\") "
Jul 27 18:09:48.494932 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.494899    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/312b9bb4-2b14-4f5d-a072-296e83ef533f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "312b9bb4-2b14-4f5d-a072-296e83ef533f" (UID: "312b9bb4-2b14-4f5d-a072-296e83ef533f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:09:48.495050 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.494949    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef7999cd-e8dd-4b96-b6cd-086f688f3b71-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ef7999cd-e8dd-4b96-b6cd-086f688f3b71" (UID: "ef7999cd-e8dd-4b96-b6cd-086f688f3b71"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:09:48.496708 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.496683    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef7999cd-e8dd-4b96-b6cd-086f688f3b71-kube-api-access-f4gxp" (OuterVolumeSpecName: "kube-api-access-f4gxp") pod "ef7999cd-e8dd-4b96-b6cd-086f688f3b71" (UID: "ef7999cd-e8dd-4b96-b6cd-086f688f3b71"). InnerVolumeSpecName "kube-api-access-f4gxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:09:48.496804 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.496714    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/312b9bb4-2b14-4f5d-a072-296e83ef533f-kube-api-access-rlcsc" (OuterVolumeSpecName: "kube-api-access-rlcsc") pod "312b9bb4-2b14-4f5d-a072-296e83ef533f" (UID: "312b9bb4-2b14-4f5d-a072-296e83ef533f"). InnerVolumeSpecName "kube-api-access-rlcsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:09:48.596161 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.596125    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4gxp\" (UniqueName: \"kubernetes.io/projected/ef7999cd-e8dd-4b96-b6cd-086f688f3b71-kube-api-access-f4gxp\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:09:48.596161 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.596155    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/312b9bb4-2b14-4f5d-a072-296e83ef533f-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:09:48.596161 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.596166    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlcsc\" (UniqueName: \"kubernetes.io/projected/312b9bb4-2b14-4f5d-a072-296e83ef533f-kube-api-access-rlcsc\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:09:48.596401 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:48.596175    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef7999cd-e8dd-4b96-b6cd-086f688f3b71-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:09:49.352899 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:49.352867    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"
Jul 27 18:09:49.353373 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:49.352911    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt" event={"ID":"ef7999cd-e8dd-4b96-b6cd-086f688f3b71","Type":"ContainerDied","Data":"0cf562afceaf944df1333bdaefa5339d077587664e715e494380a6ce4d61cf02"}
Jul 27 18:09:49.353373 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:49.352965    2580 scope.go:117] "RemoveContainer" containerID="cae44cf30f0a0c6cc6d2deccb43fc3d347bb8bef2fd3a52728232ba1f9b031f5"
Jul 27 18:09:49.354339 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:49.354319    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn" event={"ID":"312b9bb4-2b14-4f5d-a072-296e83ef533f","Type":"ContainerDied","Data":"e8e5ebe7a4edb6790bb80f7454b1b800dc5184cf74834baade17c6985928e98d"}
Jul 27 18:09:49.354433 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:49.354343    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"
Jul 27 18:09:49.363353 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:49.363047    2580 scope.go:117] "RemoveContainer" containerID="a39afa73693466ee12adf6250f726d3e97fc234a699ffdca2d509760bad0dc43"
Jul 27 18:09:49.377682 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:49.377662    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"]
Jul 27 18:09:49.383301 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:49.383280    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0a1799-7d74bf57db-g79mn"]
Jul 27 18:09:49.391925 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:49.391904    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"]
Jul 27 18:09:49.397640 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:49.397623    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0a1799-6c7b48656-kdwlt"]
Jul 27 18:09:49.476493 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:49.476465    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="312b9bb4-2b14-4f5d-a072-296e83ef533f" path="/var/lib/kubelet/pods/312b9bb4-2b14-4f5d-a072-296e83ef533f/volumes"
Jul 27 18:09:49.476904 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:49.476888    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef7999cd-e8dd-4b96-b6cd-086f688f3b71" path="/var/lib/kubelet/pods/ef7999cd-e8dd-4b96-b6cd-086f688f3b71/volumes"
Jul 27 18:09:59.042711 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:59.042666    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"]
Jul 27 18:09:59.043163 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:09:59.042963    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt" podUID="744743bc-02cb-4b7d-bcae-4389bc9a0435" containerName="istio-proxy" containerID="cri-o://8e8f0b5e1fa19b5fb2f15470d74f86fc85e704d50325f165249b28149d1728f0" gracePeriod=30
Jul 27 18:10:01.223020 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:01.222982    2580 patch_prober.go:28] interesting pod/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 18:10:01.223391 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:01.223054    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt" podUID="744743bc-02cb-4b7d-bcae-4389bc9a0435" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 18:10:04.308738 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.308679    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:10:04.430098 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.430067    2580 generic.go:356] "Generic (PLEG): container finished" podID="744743bc-02cb-4b7d-bcae-4389bc9a0435" containerID="8e8f0b5e1fa19b5fb2f15470d74f86fc85e704d50325f165249b28149d1728f0" exitCode=0
Jul 27 18:10:04.430098 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.430102    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt" event={"ID":"744743bc-02cb-4b7d-bcae-4389bc9a0435","Type":"ContainerDied","Data":"8e8f0b5e1fa19b5fb2f15470d74f86fc85e704d50325f165249b28149d1728f0"}
Jul 27 18:10:04.430311 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.430113    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"
Jul 27 18:10:04.430311 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.430146    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt" event={"ID":"744743bc-02cb-4b7d-bcae-4389bc9a0435","Type":"ContainerDied","Data":"158cea9d86416e32a54101f171262bc3db1b3d120558502f26e647544cfd9b2d"}
Jul 27 18:10:04.430311 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.430168    2580 scope.go:117] "RemoveContainer" containerID="8e8f0b5e1fa19b5fb2f15470d74f86fc85e704d50325f165249b28149d1728f0"
Jul 27 18:10:04.438671 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.438561    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-credential-socket\") pod \"744743bc-02cb-4b7d-bcae-4389bc9a0435\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") "
Jul 27 18:10:04.438671 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.438634    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-podinfo\") pod \"744743bc-02cb-4b7d-bcae-4389bc9a0435\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") "
Jul 27 18:10:04.438671 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.438667    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrqwx\" (UniqueName: \"kubernetes.io/projected/744743bc-02cb-4b7d-bcae-4389bc9a0435-kube-api-access-jrqwx\") pod \"744743bc-02cb-4b7d-bcae-4389bc9a0435\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") "
Jul 27 18:10:04.438852 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.438670    2580 scope.go:117] "RemoveContainer" containerID="39449818d9ca5f9d72c621211ad73db09e88aabbd32b60c64734ba8fc2fff40e"
Jul 27 18:10:04.438852 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.438693    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-workload-socket\") pod \"744743bc-02cb-4b7d-bcae-4389bc9a0435\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") "
Jul 27 18:10:04.438852 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.438731    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-data\") pod \"744743bc-02cb-4b7d-bcae-4389bc9a0435\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") "
Jul 27 18:10:04.438852 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.438763    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-workload-certs\") pod \"744743bc-02cb-4b7d-bcae-4389bc9a0435\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") "
Jul 27 18:10:04.438852 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.438779    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "744743bc-02cb-4b7d-bcae-4389bc9a0435" (UID: "744743bc-02cb-4b7d-bcae-4389bc9a0435"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:10:04.438852 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.438808    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-token\") pod \"744743bc-02cb-4b7d-bcae-4389bc9a0435\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") "
Jul 27 18:10:04.439157 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.438900    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/744743bc-02cb-4b7d-bcae-4389bc9a0435-istiod-ca-cert\") pod \"744743bc-02cb-4b7d-bcae-4389bc9a0435\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") "
Jul 27 18:10:04.439157 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.438929    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-envoy\") pod \"744743bc-02cb-4b7d-bcae-4389bc9a0435\" (UID: \"744743bc-02cb-4b7d-bcae-4389bc9a0435\") "
Jul 27 18:10:04.439157 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.439102    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "744743bc-02cb-4b7d-bcae-4389bc9a0435" (UID: "744743bc-02cb-4b7d-bcae-4389bc9a0435"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:10:04.439321 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.439276    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:04.439321 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.439290    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:04.439768 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.439533    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-data" (OuterVolumeSpecName: "istio-data") pod "744743bc-02cb-4b7d-bcae-4389bc9a0435" (UID: "744743bc-02cb-4b7d-bcae-4389bc9a0435"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:10:04.439768 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.439684    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "744743bc-02cb-4b7d-bcae-4389bc9a0435" (UID: "744743bc-02cb-4b7d-bcae-4389bc9a0435"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:10:04.439925 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.439769    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/744743bc-02cb-4b7d-bcae-4389bc9a0435-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "744743bc-02cb-4b7d-bcae-4389bc9a0435" (UID: "744743bc-02cb-4b7d-bcae-4389bc9a0435"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:10:04.441044 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.441007    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "744743bc-02cb-4b7d-bcae-4389bc9a0435" (UID: "744743bc-02cb-4b7d-bcae-4389bc9a0435"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 18:10:04.441328 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.441303    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-token" (OuterVolumeSpecName: "istio-token") pod "744743bc-02cb-4b7d-bcae-4389bc9a0435" (UID: "744743bc-02cb-4b7d-bcae-4389bc9a0435"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:10:04.441445 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.441332    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/744743bc-02cb-4b7d-bcae-4389bc9a0435-kube-api-access-jrqwx" (OuterVolumeSpecName: "kube-api-access-jrqwx") pod "744743bc-02cb-4b7d-bcae-4389bc9a0435" (UID: "744743bc-02cb-4b7d-bcae-4389bc9a0435"). InnerVolumeSpecName "kube-api-access-jrqwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:10:04.441445 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.441373    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "744743bc-02cb-4b7d-bcae-4389bc9a0435" (UID: "744743bc-02cb-4b7d-bcae-4389bc9a0435"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:10:04.459323 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.459305    2580 scope.go:117] "RemoveContainer" containerID="8e8f0b5e1fa19b5fb2f15470d74f86fc85e704d50325f165249b28149d1728f0"
Jul 27 18:10:04.459597 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:10:04.459563    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e8f0b5e1fa19b5fb2f15470d74f86fc85e704d50325f165249b28149d1728f0\": container with ID starting with 8e8f0b5e1fa19b5fb2f15470d74f86fc85e704d50325f165249b28149d1728f0 not found: ID does not exist" containerID="8e8f0b5e1fa19b5fb2f15470d74f86fc85e704d50325f165249b28149d1728f0"
Jul 27 18:10:04.459667 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.459604    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e8f0b5e1fa19b5fb2f15470d74f86fc85e704d50325f165249b28149d1728f0"} err="failed to get container status \"8e8f0b5e1fa19b5fb2f15470d74f86fc85e704d50325f165249b28149d1728f0\": rpc error: code = NotFound desc = could not find container \"8e8f0b5e1fa19b5fb2f15470d74f86fc85e704d50325f165249b28149d1728f0\": container with ID starting with 8e8f0b5e1fa19b5fb2f15470d74f86fc85e704d50325f165249b28149d1728f0 not found: ID does not exist"
Jul 27 18:10:04.459667 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.459628    2580 scope.go:117] "RemoveContainer" containerID="39449818d9ca5f9d72c621211ad73db09e88aabbd32b60c64734ba8fc2fff40e"
Jul 27 18:10:04.459864 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:10:04.459849    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39449818d9ca5f9d72c621211ad73db09e88aabbd32b60c64734ba8fc2fff40e\": container with ID starting with 39449818d9ca5f9d72c621211ad73db09e88aabbd32b60c64734ba8fc2fff40e not found: ID does not exist" containerID="39449818d9ca5f9d72c621211ad73db09e88aabbd32b60c64734ba8fc2fff40e"
Jul 27 18:10:04.459905 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.459868    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39449818d9ca5f9d72c621211ad73db09e88aabbd32b60c64734ba8fc2fff40e"} err="failed to get container status \"39449818d9ca5f9d72c621211ad73db09e88aabbd32b60c64734ba8fc2fff40e\": rpc error: code = NotFound desc = could not find container \"39449818d9ca5f9d72c621211ad73db09e88aabbd32b60c64734ba8fc2fff40e\": container with ID starting with 39449818d9ca5f9d72c621211ad73db09e88aabbd32b60c64734ba8fc2fff40e not found: ID does not exist"
Jul 27 18:10:04.540602 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.540561    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:04.540602 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.540601    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:04.540732 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.540611    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:04.540732 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.540620    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/744743bc-02cb-4b7d-bcae-4389bc9a0435-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:04.540732 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.540627    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:04.540732 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.540634    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/744743bc-02cb-4b7d-bcae-4389bc9a0435-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:04.540732 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.540642    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrqwx\" (UniqueName: \"kubernetes.io/projected/744743bc-02cb-4b7d-bcae-4389bc9a0435-kube-api-access-jrqwx\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:04.752126 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.752101    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"]
Jul 27 18:10:04.755865 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:04.755840    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-0a1799-openshift-default-6d5c9ddf5d-tj8lt"]
Jul 27 18:10:05.476040 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:05.476007    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="744743bc-02cb-4b7d-bcae-4389bc9a0435" path="/var/lib/kubelet/pods/744743bc-02cb-4b7d-bcae-4389bc9a0435/volumes"
Jul 27 18:10:14.911862 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:14.911828    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"]
Jul 27 18:10:14.912421 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:14.912097    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm" podUID="41ceb886-b3f6-4e58-a361-6b988a77ecd2" containerName="payload-processing" containerID="cri-o://a11fc81d79ebcad08188dd45b7e7e821981a2a10c80685fcdd130a329ef1c319" gracePeriod=30
Jul 27 18:10:14.919525 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:14.919496    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"]
Jul 27 18:10:14.920252 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:14.919857    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7" podUID="85eddeeb-db72-49a0-9b59-fc2823fadb29" containerName="payload-pre-processing" containerID="cri-o://01c203937fbd65b160c81a8b405d951f9bb608d851fa9ec1dcd226159b840c45" gracePeriod=30
Jul 27 18:10:15.179608 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.179566    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"
Jul 27 18:10:15.204011 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.203979    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"
Jul 27 18:10:15.333631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.333567    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41ceb886-b3f6-4e58-a361-6b988a77ecd2-plugins-config-volume\") pod \"41ceb886-b3f6-4e58-a361-6b988a77ecd2\" (UID: \"41ceb886-b3f6-4e58-a361-6b988a77ecd2\") "
Jul 27 18:10:15.333802 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.333771    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85eddeeb-db72-49a0-9b59-fc2823fadb29-plugins-config-volume\") pod \"85eddeeb-db72-49a0-9b59-fc2823fadb29\" (UID: \"85eddeeb-db72-49a0-9b59-fc2823fadb29\") "
Jul 27 18:10:15.333889 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.333822    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqtnv\" (UniqueName: \"kubernetes.io/projected/41ceb886-b3f6-4e58-a361-6b988a77ecd2-kube-api-access-nqtnv\") pod \"41ceb886-b3f6-4e58-a361-6b988a77ecd2\" (UID: \"41ceb886-b3f6-4e58-a361-6b988a77ecd2\") "
Jul 27 18:10:15.333889 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.333865    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt62d\" (UniqueName: \"kubernetes.io/projected/85eddeeb-db72-49a0-9b59-fc2823fadb29-kube-api-access-xt62d\") pod \"85eddeeb-db72-49a0-9b59-fc2823fadb29\" (UID: \"85eddeeb-db72-49a0-9b59-fc2823fadb29\") "
Jul 27 18:10:15.334059 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.334022    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41ceb886-b3f6-4e58-a361-6b988a77ecd2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "41ceb886-b3f6-4e58-a361-6b988a77ecd2" (UID: "41ceb886-b3f6-4e58-a361-6b988a77ecd2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:10:15.334177 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.334154    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85eddeeb-db72-49a0-9b59-fc2823fadb29-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "85eddeeb-db72-49a0-9b59-fc2823fadb29" (UID: "85eddeeb-db72-49a0-9b59-fc2823fadb29"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:10:15.334223 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.334213    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41ceb886-b3f6-4e58-a361-6b988a77ecd2-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:15.335955 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.335929    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85eddeeb-db72-49a0-9b59-fc2823fadb29-kube-api-access-xt62d" (OuterVolumeSpecName: "kube-api-access-xt62d") pod "85eddeeb-db72-49a0-9b59-fc2823fadb29" (UID: "85eddeeb-db72-49a0-9b59-fc2823fadb29"). InnerVolumeSpecName "kube-api-access-xt62d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:10:15.335955 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.335939    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41ceb886-b3f6-4e58-a361-6b988a77ecd2-kube-api-access-nqtnv" (OuterVolumeSpecName: "kube-api-access-nqtnv") pod "41ceb886-b3f6-4e58-a361-6b988a77ecd2" (UID: "41ceb886-b3f6-4e58-a361-6b988a77ecd2"). InnerVolumeSpecName "kube-api-access-nqtnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:10:15.434762 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.434681    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt62d\" (UniqueName: \"kubernetes.io/projected/85eddeeb-db72-49a0-9b59-fc2823fadb29-kube-api-access-xt62d\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:15.434762 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.434706    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85eddeeb-db72-49a0-9b59-fc2823fadb29-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:15.434762 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.434716    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqtnv\" (UniqueName: \"kubernetes.io/projected/41ceb886-b3f6-4e58-a361-6b988a77ecd2-kube-api-access-nqtnv\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:15.488290 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.488263    2580 generic.go:356] "Generic (PLEG): container finished" podID="41ceb886-b3f6-4e58-a361-6b988a77ecd2" containerID="a11fc81d79ebcad08188dd45b7e7e821981a2a10c80685fcdd130a329ef1c319" exitCode=0
Jul 27 18:10:15.488395 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.488315    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"
Jul 27 18:10:15.488395 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.488340    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm" event={"ID":"41ceb886-b3f6-4e58-a361-6b988a77ecd2","Type":"ContainerDied","Data":"a11fc81d79ebcad08188dd45b7e7e821981a2a10c80685fcdd130a329ef1c319"}
Jul 27 18:10:15.488395 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.488389    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm" event={"ID":"41ceb886-b3f6-4e58-a361-6b988a77ecd2","Type":"ContainerDied","Data":"37619abebdd6f4f0ec42b46c70e893ab4cb36b69e91486224ac088a1dbfe3f21"}
Jul 27 18:10:15.488520 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.488410    2580 scope.go:117] "RemoveContainer" containerID="a11fc81d79ebcad08188dd45b7e7e821981a2a10c80685fcdd130a329ef1c319"
Jul 27 18:10:15.489803 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.489783    2580 generic.go:356] "Generic (PLEG): container finished" podID="85eddeeb-db72-49a0-9b59-fc2823fadb29" containerID="01c203937fbd65b160c81a8b405d951f9bb608d851fa9ec1dcd226159b840c45" exitCode=0
Jul 27 18:10:15.489915 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.489838    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"
Jul 27 18:10:15.490020 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.489835    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7" event={"ID":"85eddeeb-db72-49a0-9b59-fc2823fadb29","Type":"ContainerDied","Data":"01c203937fbd65b160c81a8b405d951f9bb608d851fa9ec1dcd226159b840c45"}
Jul 27 18:10:15.490020 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.489970    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7" event={"ID":"85eddeeb-db72-49a0-9b59-fc2823fadb29","Type":"ContainerDied","Data":"73d5d2e1356cee14a214e224bec37f3f333365d484d36c61cf405fe115a564bf"}
Jul 27 18:10:15.497169 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.497146    2580 scope.go:117] "RemoveContainer" containerID="a11fc81d79ebcad08188dd45b7e7e821981a2a10c80685fcdd130a329ef1c319"
Jul 27 18:10:15.497406 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:10:15.497388    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a11fc81d79ebcad08188dd45b7e7e821981a2a10c80685fcdd130a329ef1c319\": container with ID starting with a11fc81d79ebcad08188dd45b7e7e821981a2a10c80685fcdd130a329ef1c319 not found: ID does not exist" containerID="a11fc81d79ebcad08188dd45b7e7e821981a2a10c80685fcdd130a329ef1c319"
Jul 27 18:10:15.497467 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.497413    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a11fc81d79ebcad08188dd45b7e7e821981a2a10c80685fcdd130a329ef1c319"} err="failed to get container status \"a11fc81d79ebcad08188dd45b7e7e821981a2a10c80685fcdd130a329ef1c319\": rpc error: code = NotFound desc = could not find container \"a11fc81d79ebcad08188dd45b7e7e821981a2a10c80685fcdd130a329ef1c319\": container with ID starting with a11fc81d79ebcad08188dd45b7e7e821981a2a10c80685fcdd130a329ef1c319 not found: ID does not exist"
Jul 27 18:10:15.497467 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.497428    2580 scope.go:117] "RemoveContainer" containerID="01c203937fbd65b160c81a8b405d951f9bb608d851fa9ec1dcd226159b840c45"
Jul 27 18:10:15.504859 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.504835    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"]
Jul 27 18:10:15.505246 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.505233    2580 scope.go:117] "RemoveContainer" containerID="01c203937fbd65b160c81a8b405d951f9bb608d851fa9ec1dcd226159b840c45"
Jul 27 18:10:15.505511 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:10:15.505492    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01c203937fbd65b160c81a8b405d951f9bb608d851fa9ec1dcd226159b840c45\": container with ID starting with 01c203937fbd65b160c81a8b405d951f9bb608d851fa9ec1dcd226159b840c45 not found: ID does not exist" containerID="01c203937fbd65b160c81a8b405d951f9bb608d851fa9ec1dcd226159b840c45"
Jul 27 18:10:15.505632 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.505520    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01c203937fbd65b160c81a8b405d951f9bb608d851fa9ec1dcd226159b840c45"} err="failed to get container status \"01c203937fbd65b160c81a8b405d951f9bb608d851fa9ec1dcd226159b840c45\": rpc error: code = NotFound desc = could not find container \"01c203937fbd65b160c81a8b405d951f9bb608d851fa9ec1dcd226159b840c45\": container with ID starting with 01c203937fbd65b160c81a8b405d951f9bb608d851fa9ec1dcd226159b840c45 not found: ID does not exist"
Jul 27 18:10:15.508980 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.508960    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-47ce04-6f64d4657b-w9mwm"]
Jul 27 18:10:15.520521 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.520501    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"]
Jul 27 18:10:15.524734 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:15.524714    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-47ce04-b8b4c9b4d-czlt7"]
Jul 27 18:10:17.477504 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:17.477467    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41ceb886-b3f6-4e58-a361-6b988a77ecd2" path="/var/lib/kubelet/pods/41ceb886-b3f6-4e58-a361-6b988a77ecd2/volumes"
Jul 27 18:10:17.477894 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:17.477859    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85eddeeb-db72-49a0-9b59-fc2823fadb29" path="/var/lib/kubelet/pods/85eddeeb-db72-49a0-9b59-fc2823fadb29/volumes"
Jul 27 18:10:26.022147 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.022112    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"]
Jul 27 18:10:26.022544 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.022334    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8" podUID="e01baf2b-9572-4cfe-bc4a-d3389fd317ec" containerName="istio-proxy" containerID="cri-o://6bd31b72b09e52c22be1f3b470050f5553efeeb5138aa4417894420813f94447" gracePeriod=30
Jul 27 18:10:26.905344 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905315    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"]
Jul 27 18:10:26.905706 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905691    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41ceb886-b3f6-4e58-a361-6b988a77ecd2" containerName="payload-processing"
Jul 27 18:10:26.905775 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905707    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="41ceb886-b3f6-4e58-a361-6b988a77ecd2" containerName="payload-processing"
Jul 27 18:10:26.905775 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905718    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="744743bc-02cb-4b7d-bcae-4389bc9a0435" containerName="istio-proxy"
Jul 27 18:10:26.905775 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905723    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="744743bc-02cb-4b7d-bcae-4389bc9a0435" containerName="istio-proxy"
Jul 27 18:10:26.905775 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905747    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="312b9bb4-2b14-4f5d-a072-296e83ef533f" containerName="payload-processing"
Jul 27 18:10:26.905775 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905753    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="312b9bb4-2b14-4f5d-a072-296e83ef533f" containerName="payload-processing"
Jul 27 18:10:26.905775 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905761    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85eddeeb-db72-49a0-9b59-fc2823fadb29" containerName="payload-pre-processing"
Jul 27 18:10:26.905775 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905766    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="85eddeeb-db72-49a0-9b59-fc2823fadb29" containerName="payload-pre-processing"
Jul 27 18:10:26.905775 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905773    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7999cd-e8dd-4b96-b6cd-086f688f3b71" containerName="payload-pre-processing"
Jul 27 18:10:26.905775 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905778    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7999cd-e8dd-4b96-b6cd-086f688f3b71" containerName="payload-pre-processing"
Jul 27 18:10:26.906063 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905835    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="744743bc-02cb-4b7d-bcae-4389bc9a0435" containerName="istio-proxy"
Jul 27 18:10:26.906063 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905841    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="85eddeeb-db72-49a0-9b59-fc2823fadb29" containerName="payload-pre-processing"
Jul 27 18:10:26.906063 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905848    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef7999cd-e8dd-4b96-b6cd-086f688f3b71" containerName="payload-pre-processing"
Jul 27 18:10:26.906063 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905854    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="41ceb886-b3f6-4e58-a361-6b988a77ecd2" containerName="payload-processing"
Jul 27 18:10:26.906063 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905863    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="312b9bb4-2b14-4f5d-a072-296e83ef533f" containerName="payload-processing"
Jul 27 18:10:26.906063 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.905868    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="744743bc-02cb-4b7d-bcae-4389bc9a0435" containerName="istio-proxy"
Jul 27 18:10:26.908900 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.908881    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:26.912005 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.911981    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-addd0c-openshift-default-dockercfg-q2sv9\""
Jul 27 18:10:26.924360 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.924333    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"]
Jul 27 18:10:26.943204 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.943176    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr9xx\" (UniqueName: \"kubernetes.io/projected/3d4c16df-e246-45da-8cbd-84ee0c04f24a-kube-api-access-gr9xx\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:26.943339 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.943231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-credential-socket\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:26.943339 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.943273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istiod-ca-cert\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:26.943339 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.943314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-envoy\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:26.943339 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.943336    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-token\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:26.943593 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.943384    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-data\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:26.943593 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.943437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-workload-certs\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:26.943593 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.943478    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-workload-socket\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:26.943593 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:26.943515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-podinfo\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.044847 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.044806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr9xx\" (UniqueName: \"kubernetes.io/projected/3d4c16df-e246-45da-8cbd-84ee0c04f24a-kube-api-access-gr9xx\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.045292 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.044861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-credential-socket\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.045292 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.044896    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istiod-ca-cert\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.045292 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.044932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-envoy\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.045292 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.044958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-token\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.045292 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.045109    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-data\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.045292 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.045159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-workload-certs\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.045292 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.045214    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-workload-socket\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.045292 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.045253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-podinfo\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.045784 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.045339    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-credential-socket\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.045784 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.045566    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-workload-socket\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.045784 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.045632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-data\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.045784 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.045649    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-workload-certs\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.045940 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.045875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istiod-ca-cert\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.047342 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.047313    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-envoy\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.047652 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.047635    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-podinfo\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.053556 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.053534    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-token\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.053935 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.053911    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr9xx\" (UniqueName: \"kubernetes.io/projected/3d4c16df-e246-45da-8cbd-84ee0c04f24a-kube-api-access-gr9xx\") pod \"e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") " pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.219385 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.219295    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:27.359827 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.359802    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"]
Jul 27 18:10:27.361647 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:10:27.361617    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d4c16df_e246_45da_8cbd_84ee0c04f24a.slice/crio-1f0368ca1cab7ca330017a04c3cdc1ff9c74458e2f565c63492d1ff427e6cdca WatchSource:0}: Error finding container 1f0368ca1cab7ca330017a04c3cdc1ff9c74458e2f565c63492d1ff427e6cdca: Status 404 returned error can't find the container with id 1f0368ca1cab7ca330017a04c3cdc1ff9c74458e2f565c63492d1ff427e6cdca
Jul 27 18:10:27.364172 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.364141    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:10:27.364234 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.364214    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:10:27.364275 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.364245    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:10:27.551349 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.551263    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8" event={"ID":"3d4c16df-e246-45da-8cbd-84ee0c04f24a","Type":"ContainerStarted","Data":"e2db9d3f77b4339521494c292a5bdd0a74586abcbc08b91ed9a6dae1c91dd9fd"}
Jul 27 18:10:27.551349 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.551323    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8" event={"ID":"3d4c16df-e246-45da-8cbd-84ee0c04f24a","Type":"ContainerStarted","Data":"1f0368ca1cab7ca330017a04c3cdc1ff9c74458e2f565c63492d1ff427e6cdca"}
Jul 27 18:10:27.574994 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:27.574948    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8" podStartSLOduration=1.574932441 podStartE2EDuration="1.574932441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:10:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:10:27.573328867 +0000 UTC m=+2770.587995311" watchObservedRunningTime="2026-07-27 18:10:27.574932441 +0000 UTC m=+2770.589598884"
Jul 27 18:10:28.219644 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:28.219613    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:28.224651 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:28.224625    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:28.555955 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:28.555875    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:28.556728 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:28.556710    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:30.148386 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.148350    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"]
Jul 27 18:10:30.148857 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.148813    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="744743bc-02cb-4b7d-bcae-4389bc9a0435" containerName="istio-proxy"
Jul 27 18:10:30.148857 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.148829    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="744743bc-02cb-4b7d-bcae-4389bc9a0435" containerName="istio-proxy"
Jul 27 18:10:30.152084 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.152067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"
Jul 27 18:10:30.154248 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.154218    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-addd0c\""
Jul 27 18:10:30.154374 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.154259    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-addd0c-dockercfg-c4wm6\""
Jul 27 18:10:30.159765 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.159745    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"]
Jul 27 18:10:30.172324 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.172301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkbmf\" (UniqueName: \"kubernetes.io/projected/961f46af-2baf-4a36-a751-67077405d442-kube-api-access-zkbmf\") pod \"payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv\" (UID: \"961f46af-2baf-4a36-a751-67077405d442\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"
Jul 27 18:10:30.172442 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.172364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/961f46af-2baf-4a36-a751-67077405d442-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv\" (UID: \"961f46af-2baf-4a36-a751-67077405d442\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"
Jul 27 18:10:30.172543 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.172522    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"]
Jul 27 18:10:30.175883 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.175862    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"
Jul 27 18:10:30.186933 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.186909    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"]
Jul 27 18:10:30.273411 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.273374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63fce40f-b233-4412-9139-4e0eab0ce763-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw\" (UID: \"63fce40f-b233-4412-9139-4e0eab0ce763\") " pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"
Jul 27 18:10:30.273411 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.273417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhrfq\" (UniqueName: \"kubernetes.io/projected/63fce40f-b233-4412-9139-4e0eab0ce763-kube-api-access-vhrfq\") pod \"payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw\" (UID: \"63fce40f-b233-4412-9139-4e0eab0ce763\") " pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"
Jul 27 18:10:30.273719 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.273537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkbmf\" (UniqueName: \"kubernetes.io/projected/961f46af-2baf-4a36-a751-67077405d442-kube-api-access-zkbmf\") pod \"payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv\" (UID: \"961f46af-2baf-4a36-a751-67077405d442\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"
Jul 27 18:10:30.273719 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.273675    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/961f46af-2baf-4a36-a751-67077405d442-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv\" (UID: \"961f46af-2baf-4a36-a751-67077405d442\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"
Jul 27 18:10:30.274360 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.274339    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/961f46af-2baf-4a36-a751-67077405d442-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv\" (UID: \"961f46af-2baf-4a36-a751-67077405d442\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"
Jul 27 18:10:30.282085 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.282060    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkbmf\" (UniqueName: \"kubernetes.io/projected/961f46af-2baf-4a36-a751-67077405d442-kube-api-access-zkbmf\") pod \"payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv\" (UID: \"961f46af-2baf-4a36-a751-67077405d442\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"
Jul 27 18:10:30.374533 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.374497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63fce40f-b233-4412-9139-4e0eab0ce763-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw\" (UID: \"63fce40f-b233-4412-9139-4e0eab0ce763\") " pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"
Jul 27 18:10:30.374533 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.374534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhrfq\" (UniqueName: \"kubernetes.io/projected/63fce40f-b233-4412-9139-4e0eab0ce763-kube-api-access-vhrfq\") pod \"payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw\" (UID: \"63fce40f-b233-4412-9139-4e0eab0ce763\") " pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"
Jul 27 18:10:30.375203 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.375181    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63fce40f-b233-4412-9139-4e0eab0ce763-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw\" (UID: \"63fce40f-b233-4412-9139-4e0eab0ce763\") " pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"
Jul 27 18:10:30.383923 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.383895    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhrfq\" (UniqueName: \"kubernetes.io/projected/63fce40f-b233-4412-9139-4e0eab0ce763-kube-api-access-vhrfq\") pod \"payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw\" (UID: \"63fce40f-b233-4412-9139-4e0eab0ce763\") " pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"
Jul 27 18:10:30.463835 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.463800    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"
Jul 27 18:10:30.487227 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.487199    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"
Jul 27 18:10:30.619015 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.618973    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"]
Jul 27 18:10:30.620966 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:10:30.620937    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961f46af_2baf_4a36_a751_67077405d442.slice/crio-17509fd0268730c07375394427b2fc7492740c50f9fd92089e85089dfab3e6c1 WatchSource:0}: Error finding container 17509fd0268730c07375394427b2fc7492740c50f9fd92089e85089dfab3e6c1: Status 404 returned error can't find the container with id 17509fd0268730c07375394427b2fc7492740c50f9fd92089e85089dfab3e6c1
Jul 27 18:10:30.849219 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:30.849194    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"]
Jul 27 18:10:30.851620 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:10:30.851593    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63fce40f_b233_4412_9139_4e0eab0ce763.slice/crio-6b11556979a63a117e5e2c46aea5b42cd661b679b670afe9157d04147a8d5886 WatchSource:0}: Error finding container 6b11556979a63a117e5e2c46aea5b42cd661b679b670afe9157d04147a8d5886: Status 404 returned error can't find the container with id 6b11556979a63a117e5e2c46aea5b42cd661b679b670afe9157d04147a8d5886
Jul 27 18:10:31.270155 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.270128    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:10:31.282280 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.282254    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-token\") pod \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") "
Jul 27 18:10:31.282421 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.282323    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-credential-socket\") pod \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") "
Jul 27 18:10:31.282421 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.282341    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-workload-certs\") pod \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") "
Jul 27 18:10:31.282421 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.282368    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istiod-ca-cert\") pod \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") "
Jul 27 18:10:31.282421 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.282394    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-workload-socket\") pod \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") "
Jul 27 18:10:31.282421 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.282416    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-podinfo\") pod \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") "
Jul 27 18:10:31.282721 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.282479    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-envoy\") pod \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") "
Jul 27 18:10:31.282721 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.282532    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-data\") pod \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") "
Jul 27 18:10:31.282721 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.282558    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2fkt\" (UniqueName: \"kubernetes.io/projected/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-kube-api-access-b2fkt\") pod \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\" (UID: \"e01baf2b-9572-4cfe-bc4a-d3389fd317ec\") "
Jul 27 18:10:31.282721 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.282574    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e01baf2b-9572-4cfe-bc4a-d3389fd317ec" (UID: "e01baf2b-9572-4cfe-bc4a-d3389fd317ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:10:31.282939 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.282865    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:31.283122 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.283098    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e01baf2b-9572-4cfe-bc4a-d3389fd317ec" (UID: "e01baf2b-9572-4cfe-bc4a-d3389fd317ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:10:31.283222 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.283199    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e01baf2b-9572-4cfe-bc4a-d3389fd317ec" (UID: "e01baf2b-9572-4cfe-bc4a-d3389fd317ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:10:31.283310 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.283275    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e01baf2b-9572-4cfe-bc4a-d3389fd317ec" (UID: "e01baf2b-9572-4cfe-bc4a-d3389fd317ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:10:31.283469 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.283433    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "e01baf2b-9572-4cfe-bc4a-d3389fd317ec" (UID: "e01baf2b-9572-4cfe-bc4a-d3389fd317ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:10:31.285009 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.284980    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "e01baf2b-9572-4cfe-bc4a-d3389fd317ec" (UID: "e01baf2b-9572-4cfe-bc4a-d3389fd317ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:10:31.285247 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.285210    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e01baf2b-9572-4cfe-bc4a-d3389fd317ec" (UID: "e01baf2b-9572-4cfe-bc4a-d3389fd317ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:10:31.285332 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.285275    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-kube-api-access-b2fkt" (OuterVolumeSpecName: "kube-api-access-b2fkt") pod "e01baf2b-9572-4cfe-bc4a-d3389fd317ec" (UID: "e01baf2b-9572-4cfe-bc4a-d3389fd317ec"). InnerVolumeSpecName "kube-api-access-b2fkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:10:31.285406 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.285328    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e01baf2b-9572-4cfe-bc4a-d3389fd317ec" (UID: "e01baf2b-9572-4cfe-bc4a-d3389fd317ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 18:10:31.384165 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.384129    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:31.384165 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.384158    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2fkt\" (UniqueName: \"kubernetes.io/projected/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-kube-api-access-b2fkt\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:31.384165 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.384168    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:31.384399 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.384177    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:31.384399 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.384185    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:31.384399 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.384196    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:31.384399 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.384205    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:31.384399 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.384213    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e01baf2b-9572-4cfe-bc4a-d3389fd317ec-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:10:31.576595 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.576554    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw" event={"ID":"63fce40f-b233-4412-9139-4e0eab0ce763","Type":"ContainerStarted","Data":"158ba2a8210921bed196a9f04565784f27c81dcf6603c8ca62b28697fba3e816"}
Jul 27 18:10:31.576819 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.576628    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw" event={"ID":"63fce40f-b233-4412-9139-4e0eab0ce763","Type":"ContainerStarted","Data":"6b11556979a63a117e5e2c46aea5b42cd661b679b670afe9157d04147a8d5886"}
Jul 27 18:10:31.576819 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.576754    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"
Jul 27 18:10:31.578181 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.578155    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv" event={"ID":"961f46af-2baf-4a36-a751-67077405d442","Type":"ContainerStarted","Data":"def742f5aa552cfcccb0a0c5ba0d7f53642bbde2d20b6eaea87865869e625e52"}
Jul 27 18:10:31.578286 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.578202    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv" event={"ID":"961f46af-2baf-4a36-a751-67077405d442","Type":"ContainerStarted","Data":"17509fd0268730c07375394427b2fc7492740c50f9fd92089e85089dfab3e6c1"}
Jul 27 18:10:31.578286 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.578233    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"
Jul 27 18:10:31.579960 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.579933    2580 generic.go:356] "Generic (PLEG): container finished" podID="e01baf2b-9572-4cfe-bc4a-d3389fd317ec" containerID="6bd31b72b09e52c22be1f3b470050f5553efeeb5138aa4417894420813f94447" exitCode=0
Jul 27 18:10:31.580057 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.579977    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8" event={"ID":"e01baf2b-9572-4cfe-bc4a-d3389fd317ec","Type":"ContainerDied","Data":"6bd31b72b09e52c22be1f3b470050f5553efeeb5138aa4417894420813f94447"}
Jul 27 18:10:31.580057 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.579987    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"
Jul 27 18:10:31.580057 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.580012    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8" event={"ID":"e01baf2b-9572-4cfe-bc4a-d3389fd317ec","Type":"ContainerDied","Data":"b8af2352175180e21c9cd085938800bb04a7a4a9640060b60b25b28516dfe05c"}
Jul 27 18:10:31.580057 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.580030    2580 scope.go:117] "RemoveContainer" containerID="6bd31b72b09e52c22be1f3b470050f5553efeeb5138aa4417894420813f94447"
Jul 27 18:10:31.589364 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.589332    2580 scope.go:117] "RemoveContainer" containerID="3b99d55dd2c708cec2c9abb6fdceecb272716cb459a9b4f4a5f76350af34b7f4"
Jul 27 18:10:31.593894 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.593850    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw" podStartSLOduration=1.593837151 podStartE2EDuration="1.593837151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:10:31.591171114 +0000 UTC m=+2774.605837560" watchObservedRunningTime="2026-07-27 18:10:31.593837151 +0000 UTC m=+2774.608503595"
Jul 27 18:10:31.597694 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.597666    2580 scope.go:117] "RemoveContainer" containerID="6bd31b72b09e52c22be1f3b470050f5553efeeb5138aa4417894420813f94447"
Jul 27 18:10:31.597985 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:10:31.597959    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bd31b72b09e52c22be1f3b470050f5553efeeb5138aa4417894420813f94447\": container with ID starting with 6bd31b72b09e52c22be1f3b470050f5553efeeb5138aa4417894420813f94447 not found: ID does not exist" containerID="6bd31b72b09e52c22be1f3b470050f5553efeeb5138aa4417894420813f94447"
Jul 27 18:10:31.598096 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.597997    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bd31b72b09e52c22be1f3b470050f5553efeeb5138aa4417894420813f94447"} err="failed to get container status \"6bd31b72b09e52c22be1f3b470050f5553efeeb5138aa4417894420813f94447\": rpc error: code = NotFound desc = could not find container \"6bd31b72b09e52c22be1f3b470050f5553efeeb5138aa4417894420813f94447\": container with ID starting with 6bd31b72b09e52c22be1f3b470050f5553efeeb5138aa4417894420813f94447 not found: ID does not exist"
Jul 27 18:10:31.598096 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.598020    2580 scope.go:117] "RemoveContainer" containerID="3b99d55dd2c708cec2c9abb6fdceecb272716cb459a9b4f4a5f76350af34b7f4"
Jul 27 18:10:31.598382 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:10:31.598358    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b99d55dd2c708cec2c9abb6fdceecb272716cb459a9b4f4a5f76350af34b7f4\": container with ID starting with 3b99d55dd2c708cec2c9abb6fdceecb272716cb459a9b4f4a5f76350af34b7f4 not found: ID does not exist" containerID="3b99d55dd2c708cec2c9abb6fdceecb272716cb459a9b4f4a5f76350af34b7f4"
Jul 27 18:10:31.598466 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.598390    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b99d55dd2c708cec2c9abb6fdceecb272716cb459a9b4f4a5f76350af34b7f4"} err="failed to get container status \"3b99d55dd2c708cec2c9abb6fdceecb272716cb459a9b4f4a5f76350af34b7f4\": rpc error: code = NotFound desc = could not find container \"3b99d55dd2c708cec2c9abb6fdceecb272716cb459a9b4f4a5f76350af34b7f4\": container with ID starting with 3b99d55dd2c708cec2c9abb6fdceecb272716cb459a9b4f4a5f76350af34b7f4 not found: ID does not exist"
Jul 27 18:10:31.605409 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.605377    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"]
Jul 27 18:10:31.609292 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.609268    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-47ce04-openshift-default-77b7c5d456-bdrj8"]
Jul 27 18:10:31.622257 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:31.622217    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv" podStartSLOduration=1.622205704 podStartE2EDuration="1.622205704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:10:31.6199811 +0000 UTC m=+2774.634647543" watchObservedRunningTime="2026-07-27 18:10:31.622205704 +0000 UTC m=+2774.636872179"
Jul 27 18:10:33.477102 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:33.477070    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e01baf2b-9572-4cfe-bc4a-d3389fd317ec" path="/var/lib/kubelet/pods/e01baf2b-9572-4cfe-bc4a-d3389fd317ec/volumes"
Jul 27 18:10:34.556773 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.556743    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"]
Jul 27 18:10:34.557172 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.557156    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e01baf2b-9572-4cfe-bc4a-d3389fd317ec" containerName="istio-proxy"
Jul 27 18:10:34.557222 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.557174    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e01baf2b-9572-4cfe-bc4a-d3389fd317ec" containerName="istio-proxy"
Jul 27 18:10:34.557222 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.557195    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e01baf2b-9572-4cfe-bc4a-d3389fd317ec" containerName="istio-proxy"
Jul 27 18:10:34.557222 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.557201    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e01baf2b-9572-4cfe-bc4a-d3389fd317ec" containerName="istio-proxy"
Jul 27 18:10:34.557312 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.557260    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e01baf2b-9572-4cfe-bc4a-d3389fd317ec" containerName="istio-proxy"
Jul 27 18:10:34.557312 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.557269    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e01baf2b-9572-4cfe-bc4a-d3389fd317ec" containerName="istio-proxy"
Jul 27 18:10:34.561978 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.561958    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.564332 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.564309    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-1706dd-openshift-default-dockercfg-2b987\""
Jul 27 18:10:34.572301 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.572274    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"]
Jul 27 18:10:34.614023 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.613992    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-workload-socket\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.614198 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.614035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-token\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.614198 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.614094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-workload-certs\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.614198 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.614122    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-envoy\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.614198 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.614149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mthr\" (UniqueName: \"kubernetes.io/projected/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-kube-api-access-4mthr\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.614418 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.614261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istiod-ca-cert\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.614418 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.614302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-podinfo\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.614418 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.614361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-data\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.614418 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.614393    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-credential-socket\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.715091 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.715053    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-token\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.715091 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.715092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-workload-certs\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.715357 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.715110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-envoy\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.715357 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.715129    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mthr\" (UniqueName: \"kubernetes.io/projected/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-kube-api-access-4mthr\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.715357 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.715192    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istiod-ca-cert\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.715357 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.715224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-podinfo\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.715357 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.715266    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-data\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.715357 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.715294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-credential-socket\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.715357 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.715357    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-workload-socket\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.715748 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.715549    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-workload-certs\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.715748 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.715738    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-credential-socket\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.715862 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.715816    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-workload-socket\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.715950 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.715926    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-data\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.716091 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.716072    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istiod-ca-cert\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.717447 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.717425    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-envoy\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.718109 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.718078    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-podinfo\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.723058 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.723027    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-token\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.723433 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.723410    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mthr\" (UniqueName: \"kubernetes.io/projected/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-kube-api-access-4mthr\") pod \"e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") " pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:34.872478 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:34.872377    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:35.038107 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:35.038080    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"]
Jul 27 18:10:35.040056 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:10:35.040024    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbffef17_65dc_45ac_bb0f_d4a4bab3829d.slice/crio-5d9ca320f7b5b5c4bac7cf770b343f58fb918fe184249dac0a983b773909e1e6 WatchSource:0}: Error finding container 5d9ca320f7b5b5c4bac7cf770b343f58fb918fe184249dac0a983b773909e1e6: Status 404 returned error can't find the container with id 5d9ca320f7b5b5c4bac7cf770b343f58fb918fe184249dac0a983b773909e1e6
Jul 27 18:10:35.061941 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:35.061098    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:10:35.061941 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:35.061203    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:10:35.061941 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:35.061252    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:10:35.602242 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:35.602208    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh" event={"ID":"bbffef17-65dc-45ac-bb0f-d4a4bab3829d","Type":"ContainerStarted","Data":"6af3db36c544f7fcbe9cf22da5052a860e56b8ca73d0360bbbfffa7623d0723d"}
Jul 27 18:10:35.602667 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:35.602260    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh" event={"ID":"bbffef17-65dc-45ac-bb0f-d4a4bab3829d","Type":"ContainerStarted","Data":"5d9ca320f7b5b5c4bac7cf770b343f58fb918fe184249dac0a983b773909e1e6"}
Jul 27 18:10:35.623545 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:35.623494    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh" podStartSLOduration=1.6234773850000002 podStartE2EDuration="1.623477385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:10:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:10:35.622058521 +0000 UTC m=+2778.636724965" watchObservedRunningTime="2026-07-27 18:10:35.623477385 +0000 UTC m=+2778.638143829"
Jul 27 18:10:35.873515 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:35.873423    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:36.877978 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:36.877942    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:37.615608 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:37.614928    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:37.619301 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:37.619276    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:38.414575 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.414544    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"]
Jul 27 18:10:38.418185 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.418165    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"
Jul 27 18:10:38.420240 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.420223    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-1706dd-dockercfg-5586l\""
Jul 27 18:10:38.420570 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.420551    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-1706dd\""
Jul 27 18:10:38.430405 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.430380    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"]
Jul 27 18:10:38.473169 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.473127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtcm7\" (UniqueName: \"kubernetes.io/projected/7b0a49bf-bc54-4a7a-acd2-5911e294ac29-kube-api-access-mtcm7\") pod \"payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv\" (UID: \"7b0a49bf-bc54-4a7a-acd2-5911e294ac29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"
Jul 27 18:10:38.473978 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.473943    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0a49bf-bc54-4a7a-acd2-5911e294ac29-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv\" (UID: \"7b0a49bf-bc54-4a7a-acd2-5911e294ac29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"
Jul 27 18:10:38.474798 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.474768    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"]
Jul 27 18:10:38.479255 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.479233    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"
Jul 27 18:10:38.481292 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.481272    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"]
Jul 27 18:10:38.575336 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.575290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtcm7\" (UniqueName: \"kubernetes.io/projected/7b0a49bf-bc54-4a7a-acd2-5911e294ac29-kube-api-access-mtcm7\") pod \"payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv\" (UID: \"7b0a49bf-bc54-4a7a-acd2-5911e294ac29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"
Jul 27 18:10:38.575336 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.575339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0a49bf-bc54-4a7a-acd2-5911e294ac29-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv\" (UID: \"7b0a49bf-bc54-4a7a-acd2-5911e294ac29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"
Jul 27 18:10:38.575635 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.575371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2wg6\" (UniqueName: \"kubernetes.io/projected/a2720560-8b48-45bf-a885-d0d507cd7764-kube-api-access-n2wg6\") pod \"payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq\" (UID: \"a2720560-8b48-45bf-a885-d0d507cd7764\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"
Jul 27 18:10:38.575635 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.575491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2720560-8b48-45bf-a885-d0d507cd7764-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq\" (UID: \"a2720560-8b48-45bf-a885-d0d507cd7764\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"
Jul 27 18:10:38.576298 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.576269    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0a49bf-bc54-4a7a-acd2-5911e294ac29-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv\" (UID: \"7b0a49bf-bc54-4a7a-acd2-5911e294ac29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"
Jul 27 18:10:38.583795 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.583762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtcm7\" (UniqueName: \"kubernetes.io/projected/7b0a49bf-bc54-4a7a-acd2-5911e294ac29-kube-api-access-mtcm7\") pod \"payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv\" (UID: \"7b0a49bf-bc54-4a7a-acd2-5911e294ac29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"
Jul 27 18:10:38.676766 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.676659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2720560-8b48-45bf-a885-d0d507cd7764-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq\" (UID: \"a2720560-8b48-45bf-a885-d0d507cd7764\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"
Jul 27 18:10:38.676766 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.676767    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2wg6\" (UniqueName: \"kubernetes.io/projected/a2720560-8b48-45bf-a885-d0d507cd7764-kube-api-access-n2wg6\") pod \"payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq\" (UID: \"a2720560-8b48-45bf-a885-d0d507cd7764\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"
Jul 27 18:10:38.677475 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.677452    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2720560-8b48-45bf-a885-d0d507cd7764-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq\" (UID: \"a2720560-8b48-45bf-a885-d0d507cd7764\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"
Jul 27 18:10:38.684990 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.684966    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2wg6\" (UniqueName: \"kubernetes.io/projected/a2720560-8b48-45bf-a885-d0d507cd7764-kube-api-access-n2wg6\") pod \"payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq\" (UID: \"a2720560-8b48-45bf-a885-d0d507cd7764\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"
Jul 27 18:10:38.728802 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.728774    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"
Jul 27 18:10:38.790155 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.789952    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"
Jul 27 18:10:38.946443 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:38.946411    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"]
Jul 27 18:10:38.947300 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:10:38.947262    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b0a49bf_bc54_4a7a_acd2_5911e294ac29.slice/crio-8952436a864f9872b7aa8b5f5de77362b4e4643bb6ae6ccc1af85fabe9f73bfa WatchSource:0}: Error finding container 8952436a864f9872b7aa8b5f5de77362b4e4643bb6ae6ccc1af85fabe9f73bfa: Status 404 returned error can't find the container with id 8952436a864f9872b7aa8b5f5de77362b4e4643bb6ae6ccc1af85fabe9f73bfa
Jul 27 18:10:39.171216 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:39.171185    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"]
Jul 27 18:10:39.172222 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:10:39.172193    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2720560_8b48_45bf_a885_d0d507cd7764.slice/crio-08f60124eec4dc38c9d8a9c75434a6a6ad072baab81effee7fec37f5853ad417 WatchSource:0}: Error finding container 08f60124eec4dc38c9d8a9c75434a6a6ad072baab81effee7fec37f5853ad417: Status 404 returned error can't find the container with id 08f60124eec4dc38c9d8a9c75434a6a6ad072baab81effee7fec37f5853ad417
Jul 27 18:10:39.627625 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:39.627502    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq" event={"ID":"a2720560-8b48-45bf-a885-d0d507cd7764","Type":"ContainerStarted","Data":"11ef36babf901ad59cc9a03ac8d08c1ca86b61813e14c8762470f04ed6c9ae53"}
Jul 27 18:10:39.627625 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:39.627594    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"
Jul 27 18:10:39.627625 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:39.627623    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq" event={"ID":"a2720560-8b48-45bf-a885-d0d507cd7764","Type":"ContainerStarted","Data":"08f60124eec4dc38c9d8a9c75434a6a6ad072baab81effee7fec37f5853ad417"}
Jul 27 18:10:39.629421 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:39.629394    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv" event={"ID":"7b0a49bf-bc54-4a7a-acd2-5911e294ac29","Type":"ContainerStarted","Data":"2c6c63151c1ed787af6e9fe6ba8d6d223c226e99b3b9a4dbcf26e245ef901f44"}
Jul 27 18:10:39.629541 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:39.629475    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv" event={"ID":"7b0a49bf-bc54-4a7a-acd2-5911e294ac29","Type":"ContainerStarted","Data":"8952436a864f9872b7aa8b5f5de77362b4e4643bb6ae6ccc1af85fabe9f73bfa"}
Jul 27 18:10:39.629701 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:39.629683    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"
Jul 27 18:10:39.648211 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:39.648153    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq" podStartSLOduration=1.648133099 podStartE2EDuration="1.648133099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:10:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:10:39.645668038 +0000 UTC m=+2782.660334503" watchObservedRunningTime="2026-07-27 18:10:39.648133099 +0000 UTC m=+2782.662799548"
Jul 27 18:10:39.662500 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:39.662442    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv" podStartSLOduration=1.662423275 podStartE2EDuration="1.662423275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:10:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:10:39.659376823 +0000 UTC m=+2782.674043267" watchObservedRunningTime="2026-07-27 18:10:39.662423275 +0000 UTC m=+2782.677089720"
Jul 27 18:10:41.642880 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:41.642845    2580 generic.go:356] "Generic (PLEG): container finished" podID="3d4c16df-e246-45da-8cbd-84ee0c04f24a" containerID="e2db9d3f77b4339521494c292a5bdd0a74586abcbc08b91ed9a6dae1c91dd9fd" exitCode=0
Jul 27 18:10:41.642880 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:41.642883    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8" event={"ID":"3d4c16df-e246-45da-8cbd-84ee0c04f24a","Type":"ContainerDied","Data":"e2db9d3f77b4339521494c292a5bdd0a74586abcbc08b91ed9a6dae1c91dd9fd"}
Jul 27 18:10:41.643388 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:41.643235    2580 scope.go:117] "RemoveContainer" containerID="e2db9d3f77b4339521494c292a5bdd0a74586abcbc08b91ed9a6dae1c91dd9fd"
Jul 27 18:10:41.644368 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:41.644331    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:10:41.644458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:41.644442    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:10:41.644503 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:41.644490    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:10:42.588116 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:42.588080    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"
Jul 27 18:10:42.588326 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:42.588275    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"
Jul 27 18:10:42.669610 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:42.666493    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8" event={"ID":"3d4c16df-e246-45da-8cbd-84ee0c04f24a","Type":"ContainerStarted","Data":"ecd7ced47bd02c66dec35946b47d01785b74ef3dc8bab251939c7caa79f4a019"}
Jul 27 18:10:43.219862 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:43.219811    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:43.220866 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:43.220836    2580 patch_prober.go:28] interesting pod/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 27 18:10:43.220995 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:43.220892    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8" podUID="3d4c16df-e246-45da-8cbd-84ee0c04f24a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 27 18:10:43.556451 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:43.556348    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:44.219998 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:44.219957    2580 patch_prober.go:28] interesting pod/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 27 18:10:44.220425 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:44.220023    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8" podUID="3d4c16df-e246-45da-8cbd-84ee0c04f24a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 27 18:10:45.220116 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:45.220079    2580 patch_prober.go:28] interesting pod/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 27 18:10:45.220540 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:45.220138    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8" podUID="3d4c16df-e246-45da-8cbd-84ee0c04f24a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 27 18:10:46.220210 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:46.220173    2580 patch_prober.go:28] interesting pod/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 27 18:10:46.220701 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:46.220231    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8" podUID="3d4c16df-e246-45da-8cbd-84ee0c04f24a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 27 18:10:47.224335 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:47.224304    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:47.225310 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:47.225285    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:10:50.637481 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:50.637447    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"
Jul 27 18:10:50.637884 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:50.637529    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"
Jul 27 18:10:53.359981 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:53.358957    2580 patch_prober.go:28] interesting pod/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": read tcp 10.132.0.2:58258->10.132.0.89:15021: read: connection reset by peer" start-of-body=
Jul 27 18:10:53.359981 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:53.359021    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh" podUID="bbffef17-65dc-45ac-bb0f-d4a4bab3829d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": read tcp 10.132.0.2:58258->10.132.0.89:15021: read: connection reset by peer"
Jul 27 18:10:53.726290 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:53.726256    2580 generic.go:356] "Generic (PLEG): container finished" podID="bbffef17-65dc-45ac-bb0f-d4a4bab3829d" containerID="6af3db36c544f7fcbe9cf22da5052a860e56b8ca73d0360bbbfffa7623d0723d" exitCode=0
Jul 27 18:10:53.726462 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:53.726329    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh" event={"ID":"bbffef17-65dc-45ac-bb0f-d4a4bab3829d","Type":"ContainerDied","Data":"6af3db36c544f7fcbe9cf22da5052a860e56b8ca73d0360bbbfffa7623d0723d"}
Jul 27 18:10:53.726806 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:53.726791    2580 scope.go:117] "RemoveContainer" containerID="6af3db36c544f7fcbe9cf22da5052a860e56b8ca73d0360bbbfffa7623d0723d"
Jul 27 18:10:53.727907 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:53.727875    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:10:53.727987 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:53.727972    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:10:53.728028 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:53.728009    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:10:54.733470 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:54.733426    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh" event={"ID":"bbffef17-65dc-45ac-bb0f-d4a4bab3829d","Type":"ContainerStarted","Data":"21121363ace5098618fbf7e291a129682ff0beba215c30977111568a31cd300f"}
Jul 27 18:10:54.873092 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:54.873051    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:54.873339 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:54.873305    2580 patch_prober.go:28] interesting pod/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Jul 27 18:10:54.873389 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:54.873373    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh" podUID="bbffef17-65dc-45ac-bb0f-d4a4bab3829d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Jul 27 18:10:55.872977 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:55.872934    2580 patch_prober.go:28] interesting pod/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Jul 27 18:10:55.873399 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:55.872994    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh" podUID="bbffef17-65dc-45ac-bb0f-d4a4bab3829d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Jul 27 18:10:56.872994 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:56.872947    2580 patch_prober.go:28] interesting pod/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Jul 27 18:10:56.873484 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:56.873012    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh" podUID="bbffef17-65dc-45ac-bb0f-d4a4bab3829d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Jul 27 18:10:57.873231 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:57.873189    2580 patch_prober.go:28] interesting pod/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Jul 27 18:10:57.873671 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:57.873254    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh" podUID="bbffef17-65dc-45ac-bb0f-d4a4bab3829d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Jul 27 18:10:58.876927 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:58.876896    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:58.877326 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:58.877242    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:10:58.878040 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:10:58.878016    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:19:32.657145 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.657110    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"]
Jul 27 18:19:32.660713 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.660694    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.662889 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.662866    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-f4a7a7-openshift-default-dockercfg-gztnn\""
Jul 27 18:19:32.673999 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.673954    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"]
Jul 27 18:19:32.770630 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.770595    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-data\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.770837 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.770641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-token\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.770837 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.770677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c045999-2838-4ea2-ab35-69a2bf2a793e-istiod-ca-cert\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.770837 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.770768    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-credential-socket\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.770837 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.770814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-envoy\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.771069 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.770847    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2f5v\" (UniqueName: \"kubernetes.io/projected/6c045999-2838-4ea2-ab35-69a2bf2a793e-kube-api-access-p2f5v\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.771069 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.770963    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-workload-socket\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.771069 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.771023    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-workload-certs\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.771069 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.771053    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-podinfo\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.871756 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.871723    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-workload-certs\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.871756 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.871755    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-podinfo\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.871998 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.871800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-data\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.871998 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.871819    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-token\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.871998 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.871836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c045999-2838-4ea2-ab35-69a2bf2a793e-istiod-ca-cert\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.871998 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.871867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-credential-socket\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.871998 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.871901    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-envoy\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.871998 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.871942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2f5v\" (UniqueName: \"kubernetes.io/projected/6c045999-2838-4ea2-ab35-69a2bf2a793e-kube-api-access-p2f5v\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.872360 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.872007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-workload-socket\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.872360 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.872232    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-credential-socket\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.872488 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.872454    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-workload-certs\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.872557 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.872510    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-workload-socket\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.872644 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.872557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c045999-2838-4ea2-ab35-69a2bf2a793e-istiod-ca-cert\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.872694 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.872644    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-data\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.874422 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.874398    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-envoy\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.874605 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.874570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-podinfo\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.880395 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.880371    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-token\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.880499 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.880446    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2f5v\" (UniqueName: \"kubernetes.io/projected/6c045999-2838-4ea2-ab35-69a2bf2a793e-kube-api-access-p2f5v\") pod \"e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") " pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:32.971646 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:32.971559    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:33.108990 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:33.108965    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"]
Jul 27 18:19:33.110725 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:19:33.110700    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c045999_2838_4ea2_ab35_69a2bf2a793e.slice/crio-f804d2808abda53f690686ce51e41fa1b1bb92e4c2fa6643837cd875d2216788 WatchSource:0}: Error finding container f804d2808abda53f690686ce51e41fa1b1bb92e4c2fa6643837cd875d2216788: Status 404 returned error can't find the container with id f804d2808abda53f690686ce51e41fa1b1bb92e4c2fa6643837cd875d2216788
Jul 27 18:19:33.113136 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:33.113090    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:19:33.113224 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:33.113177    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:19:33.113275 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:33.113245    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:19:33.385159 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:33.385058    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662" event={"ID":"6c045999-2838-4ea2-ab35-69a2bf2a793e","Type":"ContainerStarted","Data":"2e9b58e0e4d9e3ba9d62a6aa7ea33cdf8bf82e62682a9cfc4f2a17f200aa1212"}
Jul 27 18:19:33.385159 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:33.385131    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662" event={"ID":"6c045999-2838-4ea2-ab35-69a2bf2a793e","Type":"ContainerStarted","Data":"f804d2808abda53f690686ce51e41fa1b1bb92e4c2fa6643837cd875d2216788"}
Jul 27 18:19:33.404762 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:33.404712    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662" podStartSLOduration=1.4046957789999999 podStartE2EDuration="1.404695779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:19:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:19:33.402536123 +0000 UTC m=+3316.417202567" watchObservedRunningTime="2026-07-27 18:19:33.404695779 +0000 UTC m=+3316.419362221"
Jul 27 18:19:33.972035 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:33.972006    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:34.976975 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:34.976947    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:35.395576 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:35.395492    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:35.396431 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:35.396411    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:36.197849 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:36.197816    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"]
Jul 27 18:19:36.201548 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:36.201525    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"
Jul 27 18:19:36.203502 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:36.203483    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-f4a7a7-dockercfg-2jkqk\""
Jul 27 18:19:36.203629 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:36.203483    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-f4a7a7\""
Jul 27 18:19:36.204629 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:36.204609    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56xfd\" (UniqueName: \"kubernetes.io/projected/be0c480a-0558-4efe-a07d-662074073cd9-kube-api-access-56xfd\") pod \"payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c\" (UID: \"be0c480a-0558-4efe-a07d-662074073cd9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"
Jul 27 18:19:36.204699 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:36.204686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be0c480a-0558-4efe-a07d-662074073cd9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c\" (UID: \"be0c480a-0558-4efe-a07d-662074073cd9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"
Jul 27 18:19:36.212789 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:36.212765    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"]
Jul 27 18:19:36.305607 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:36.305551    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be0c480a-0558-4efe-a07d-662074073cd9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c\" (UID: \"be0c480a-0558-4efe-a07d-662074073cd9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"
Jul 27 18:19:36.305855 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:36.305826    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56xfd\" (UniqueName: \"kubernetes.io/projected/be0c480a-0558-4efe-a07d-662074073cd9-kube-api-access-56xfd\") pod \"payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c\" (UID: \"be0c480a-0558-4efe-a07d-662074073cd9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"
Jul 27 18:19:36.306434 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:36.306408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be0c480a-0558-4efe-a07d-662074073cd9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c\" (UID: \"be0c480a-0558-4efe-a07d-662074073cd9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"
Jul 27 18:19:36.320741 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:36.320715    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56xfd\" (UniqueName: \"kubernetes.io/projected/be0c480a-0558-4efe-a07d-662074073cd9-kube-api-access-56xfd\") pod \"payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c\" (UID: \"be0c480a-0558-4efe-a07d-662074073cd9\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"
Jul 27 18:19:36.512694 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:36.512614    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"
Jul 27 18:19:36.658182 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:36.658153    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"]
Jul 27 18:19:36.659760 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:19:36.659735    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe0c480a_0558_4efe_a07d_662074073cd9.slice/crio-704bda7151957e6c3a4475287f629748c65c9831ca4a6256bcca3f19faa752b1 WatchSource:0}: Error finding container 704bda7151957e6c3a4475287f629748c65c9831ca4a6256bcca3f19faa752b1: Status 404 returned error can't find the container with id 704bda7151957e6c3a4475287f629748c65c9831ca4a6256bcca3f19faa752b1
Jul 27 18:19:37.407455 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:37.407416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c" event={"ID":"be0c480a-0558-4efe-a07d-662074073cd9","Type":"ContainerStarted","Data":"3d6a28442e2d9920616787bfbdc550bdd05fb8613220f043115c296b4a8881e1"}
Jul 27 18:19:37.407938 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:37.407472    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c" event={"ID":"be0c480a-0558-4efe-a07d-662074073cd9","Type":"ContainerStarted","Data":"704bda7151957e6c3a4475287f629748c65c9831ca4a6256bcca3f19faa752b1"}
Jul 27 18:19:37.407938 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:37.407499    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"
Jul 27 18:19:37.421967 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:37.421915    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c" podStartSLOduration=1.4218989770000001 podStartE2EDuration="1.421898977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:19:37.42166634 +0000 UTC m=+3320.436332785" watchObservedRunningTime="2026-07-27 18:19:37.421898977 +0000 UTC m=+3320.436565425"
Jul 27 18:19:48.415553 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:48.415523    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"
Jul 27 18:19:51.437808 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:51.437765    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 18:19:51.438262 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:51.437848    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662" podUID="6c045999-2838-4ea2-ab35-69a2bf2a793e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 18:19:53.505195 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:53.505163    2580 generic.go:356] "Generic (PLEG): container finished" podID="6c045999-2838-4ea2-ab35-69a2bf2a793e" containerID="2e9b58e0e4d9e3ba9d62a6aa7ea33cdf8bf82e62682a9cfc4f2a17f200aa1212" exitCode=0
Jul 27 18:19:53.505657 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:53.505245    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662" event={"ID":"6c045999-2838-4ea2-ab35-69a2bf2a793e","Type":"ContainerDied","Data":"2e9b58e0e4d9e3ba9d62a6aa7ea33cdf8bf82e62682a9cfc4f2a17f200aa1212"}
Jul 27 18:19:53.505657 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:53.505651    2580 scope.go:117] "RemoveContainer" containerID="2e9b58e0e4d9e3ba9d62a6aa7ea33cdf8bf82e62682a9cfc4f2a17f200aa1212"
Jul 27 18:19:53.506822 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:53.506793    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:19:53.506883 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:53.506866    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:19:53.506922 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:53.506897    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:19:54.512529 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:54.512494    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662" event={"ID":"6c045999-2838-4ea2-ab35-69a2bf2a793e","Type":"ContainerStarted","Data":"7d5365219d9d27f418f7cf05ad9a79cf48a27660b9077e14bc616bcbfb16fddf"}
Jul 27 18:19:54.972318 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:54.972275    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:54.972555 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:54.972531    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Jul 27 18:19:54.972647 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:54.972612    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662" podUID="6c045999-2838-4ea2-ab35-69a2bf2a793e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Jul 27 18:19:55.972709 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:55.972673    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Jul 27 18:19:55.973086 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:55.972731    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662" podUID="6c045999-2838-4ea2-ab35-69a2bf2a793e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Jul 27 18:19:56.972350 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:56.972312    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Jul 27 18:19:56.972540 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:56.972373    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662" podUID="6c045999-2838-4ea2-ab35-69a2bf2a793e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Jul 27 18:19:57.972174 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:57.972137    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Jul 27 18:19:57.972550 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:57.972195    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662" podUID="6c045999-2838-4ea2-ab35-69a2bf2a793e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Jul 27 18:19:58.653627 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:58.653567    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"]
Jul 27 18:19:58.659812 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:58.659726    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"
Jul 27 18:19:58.662310 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:58.662284    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-5cb9b7-dockercfg-gvjvm\""
Jul 27 18:19:58.662714 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:58.662288    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-5cb9b7\""
Jul 27 18:19:58.664487 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:58.664464    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"]
Jul 27 18:19:58.722091 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:58.722057    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvbpv\" (UniqueName: \"kubernetes.io/projected/6e5c2fc4-b88b-4a96-a608-38b3a46ced57-kube-api-access-bvbpv\") pod \"payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw\" (UID: \"6e5c2fc4-b88b-4a96-a608-38b3a46ced57\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"
Jul 27 18:19:58.722351 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:58.722313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e5c2fc4-b88b-4a96-a608-38b3a46ced57-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw\" (UID: \"6e5c2fc4-b88b-4a96-a608-38b3a46ced57\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"
Jul 27 18:19:58.823699 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:58.823664    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e5c2fc4-b88b-4a96-a608-38b3a46ced57-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw\" (UID: \"6e5c2fc4-b88b-4a96-a608-38b3a46ced57\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"
Jul 27 18:19:58.823906 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:58.823829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvbpv\" (UniqueName: \"kubernetes.io/projected/6e5c2fc4-b88b-4a96-a608-38b3a46ced57-kube-api-access-bvbpv\") pod \"payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw\" (UID: \"6e5c2fc4-b88b-4a96-a608-38b3a46ced57\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"
Jul 27 18:19:58.824513 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:58.824491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e5c2fc4-b88b-4a96-a608-38b3a46ced57-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw\" (UID: \"6e5c2fc4-b88b-4a96-a608-38b3a46ced57\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"
Jul 27 18:19:58.831678 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:58.831655    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvbpv\" (UniqueName: \"kubernetes.io/projected/6e5c2fc4-b88b-4a96-a608-38b3a46ced57-kube-api-access-bvbpv\") pod \"payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw\" (UID: \"6e5c2fc4-b88b-4a96-a608-38b3a46ced57\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"
Jul 27 18:19:58.974518 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:58.974429    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"
Jul 27 18:19:58.975762 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:58.975735    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:58.976257 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:58.976234    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:58.977050 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:58.977030    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:19:59.128712 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:59.128686    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"]
Jul 27 18:19:59.130515 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:19:59.130487    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5c2fc4_b88b_4a96_a608_38b3a46ced57.slice/crio-3b777411c355578eae61e3f6c8b742980d370faae3985f4144b790d9c2fcec2f WatchSource:0}: Error finding container 3b777411c355578eae61e3f6c8b742980d370faae3985f4144b790d9c2fcec2f: Status 404 returned error can't find the container with id 3b777411c355578eae61e3f6c8b742980d370faae3985f4144b790d9c2fcec2f
Jul 27 18:19:59.543252 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:59.543211    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw" event={"ID":"6e5c2fc4-b88b-4a96-a608-38b3a46ced57","Type":"ContainerStarted","Data":"bfd46294b89b4172fa37ccc28f3ae24ec4f340939d06ad4ef5654cc87e9d9ed0"}
Jul 27 18:19:59.543458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:59.543279    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw" event={"ID":"6e5c2fc4-b88b-4a96-a608-38b3a46ced57","Type":"ContainerStarted","Data":"3b777411c355578eae61e3f6c8b742980d370faae3985f4144b790d9c2fcec2f"}
Jul 27 18:19:59.543642 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:59.543616    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"
Jul 27 18:19:59.561535 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:19:59.561487    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw" podStartSLOduration=1.5614716149999999 podStartE2EDuration="1.561471615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:19:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:19:59.559668642 +0000 UTC m=+3342.574335085" watchObservedRunningTime="2026-07-27 18:19:59.561471615 +0000 UTC m=+3342.576138076"
Jul 27 18:20:11.556643 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:20:11.556610    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"
Jul 27 18:20:19.443083 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:20:19.443046    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-r7tcz_0141a4a1-9e0c-4bc9-886c-96b86eca20a7/payload-processing/0.log"
Jul 27 18:20:19.570395 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:20:19.570339    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw_6e5c2fc4-b88b-4a96-a608-38b3a46ced57/payload-processing/0.log"
Jul 27 18:21:16.653604 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:16.653515    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c_be0c480a-0558-4efe-a07d-662074073cd9/payload-processing/0.log"
Jul 27 18:21:16.777202 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:16.777174    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-r7tcz_0141a4a1-9e0c-4bc9-886c-96b86eca20a7/payload-processing/0.log"
Jul 27 18:21:16.899365 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:16.899336    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw_6e5c2fc4-b88b-4a96-a608-38b3a46ced57/payload-processing/0.log"
Jul 27 18:21:20.871928 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:20.871883    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"]
Jul 27 18:21:20.875517 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:20.875498    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"
Jul 27 18:21:20.877465 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:20.877433    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-605142\""
Jul 27 18:21:20.877567 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:20.877526    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-605142-dockercfg-vjcsv\""
Jul 27 18:21:20.885798 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:20.885773    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"]
Jul 27 18:21:21.021121 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:21.021084    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wl2k\" (UniqueName: \"kubernetes.io/projected/e92f05fe-39e6-4f99-9a2e-513af65336a0-kube-api-access-2wl2k\") pod \"payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc\" (UID: \"e92f05fe-39e6-4f99-9a2e-513af65336a0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"
Jul 27 18:21:21.021321 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:21.021231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e92f05fe-39e6-4f99-9a2e-513af65336a0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc\" (UID: \"e92f05fe-39e6-4f99-9a2e-513af65336a0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"
Jul 27 18:21:21.122537 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:21.122432    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e92f05fe-39e6-4f99-9a2e-513af65336a0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc\" (UID: \"e92f05fe-39e6-4f99-9a2e-513af65336a0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"
Jul 27 18:21:21.122537 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:21.122484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wl2k\" (UniqueName: \"kubernetes.io/projected/e92f05fe-39e6-4f99-9a2e-513af65336a0-kube-api-access-2wl2k\") pod \"payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc\" (UID: \"e92f05fe-39e6-4f99-9a2e-513af65336a0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"
Jul 27 18:21:21.123236 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:21.123209    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e92f05fe-39e6-4f99-9a2e-513af65336a0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc\" (UID: \"e92f05fe-39e6-4f99-9a2e-513af65336a0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"
Jul 27 18:21:21.130512 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:21.130486    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wl2k\" (UniqueName: \"kubernetes.io/projected/e92f05fe-39e6-4f99-9a2e-513af65336a0-kube-api-access-2wl2k\") pod \"payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc\" (UID: \"e92f05fe-39e6-4f99-9a2e-513af65336a0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"
Jul 27 18:21:21.187397 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:21.187354    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"
Jul 27 18:21:21.332609 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:21.332560    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"]
Jul 27 18:21:21.335137 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:21:21.335111    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92f05fe_39e6_4f99_9a2e_513af65336a0.slice/crio-790b081d80ae95b3fe896834b16245fb688309c458fe940d33fa3a9b2c4e9cd8 WatchSource:0}: Error finding container 790b081d80ae95b3fe896834b16245fb688309c458fe940d33fa3a9b2c4e9cd8: Status 404 returned error can't find the container with id 790b081d80ae95b3fe896834b16245fb688309c458fe940d33fa3a9b2c4e9cd8
Jul 27 18:21:21.973043 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:21.973009    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc" event={"ID":"e92f05fe-39e6-4f99-9a2e-513af65336a0","Type":"ContainerStarted","Data":"f68f0f14de4805067ebb821aac79eb94d4eb79a3f5db7350739d5077aec95c9c"}
Jul 27 18:21:21.973442 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:21.973061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc" event={"ID":"e92f05fe-39e6-4f99-9a2e-513af65336a0","Type":"ContainerStarted","Data":"790b081d80ae95b3fe896834b16245fb688309c458fe940d33fa3a9b2c4e9cd8"}
Jul 27 18:21:21.973442 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:21.973103    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"
Jul 27 18:21:21.989345 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:21.989294    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc" podStartSLOduration=1.9892779649999999 podStartE2EDuration="1.989277965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:21:21.98766034 +0000 UTC m=+3425.002326785" watchObservedRunningTime="2026-07-27 18:21:21.989277965 +0000 UTC m=+3425.003944409"
Jul 27 18:21:32.980972 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:32.980939    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"
Jul 27 18:21:45.954802 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:45.954766    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"]
Jul 27 18:21:45.955270 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:45.954994    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc" podUID="e92f05fe-39e6-4f99-9a2e-513af65336a0" containerName="payload-processing" containerID="cri-o://f68f0f14de4805067ebb821aac79eb94d4eb79a3f5db7350739d5077aec95c9c" gracePeriod=30
Jul 27 18:21:46.107887 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:46.107850    2580 generic.go:356] "Generic (PLEG): container finished" podID="e92f05fe-39e6-4f99-9a2e-513af65336a0" containerID="f68f0f14de4805067ebb821aac79eb94d4eb79a3f5db7350739d5077aec95c9c" exitCode=0
Jul 27 18:21:46.108075 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:46.107918    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc" event={"ID":"e92f05fe-39e6-4f99-9a2e-513af65336a0","Type":"ContainerDied","Data":"f68f0f14de4805067ebb821aac79eb94d4eb79a3f5db7350739d5077aec95c9c"}
Jul 27 18:21:46.215141 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:46.215076    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"
Jul 27 18:21:46.261806 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:46.261769    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e92f05fe-39e6-4f99-9a2e-513af65336a0-plugins-config-volume\") pod \"e92f05fe-39e6-4f99-9a2e-513af65336a0\" (UID: \"e92f05fe-39e6-4f99-9a2e-513af65336a0\") "
Jul 27 18:21:46.261970 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:46.261938    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wl2k\" (UniqueName: \"kubernetes.io/projected/e92f05fe-39e6-4f99-9a2e-513af65336a0-kube-api-access-2wl2k\") pod \"e92f05fe-39e6-4f99-9a2e-513af65336a0\" (UID: \"e92f05fe-39e6-4f99-9a2e-513af65336a0\") "
Jul 27 18:21:46.262202 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:46.262166    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e92f05fe-39e6-4f99-9a2e-513af65336a0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e92f05fe-39e6-4f99-9a2e-513af65336a0" (UID: "e92f05fe-39e6-4f99-9a2e-513af65336a0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:21:46.262313 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:46.262263    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e92f05fe-39e6-4f99-9a2e-513af65336a0-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:21:46.263940 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:46.263916    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e92f05fe-39e6-4f99-9a2e-513af65336a0-kube-api-access-2wl2k" (OuterVolumeSpecName: "kube-api-access-2wl2k") pod "e92f05fe-39e6-4f99-9a2e-513af65336a0" (UID: "e92f05fe-39e6-4f99-9a2e-513af65336a0"). InnerVolumeSpecName "kube-api-access-2wl2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:21:46.362771 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:46.362728    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wl2k\" (UniqueName: \"kubernetes.io/projected/e92f05fe-39e6-4f99-9a2e-513af65336a0-kube-api-access-2wl2k\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:21:47.114879 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:47.114845    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"
Jul 27 18:21:47.115297 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:47.114882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc" event={"ID":"e92f05fe-39e6-4f99-9a2e-513af65336a0","Type":"ContainerDied","Data":"790b081d80ae95b3fe896834b16245fb688309c458fe940d33fa3a9b2c4e9cd8"}
Jul 27 18:21:47.115297 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:47.114943    2580 scope.go:117] "RemoveContainer" containerID="f68f0f14de4805067ebb821aac79eb94d4eb79a3f5db7350739d5077aec95c9c"
Jul 27 18:21:47.139897 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:47.139872    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"]
Jul 27 18:21:47.144121 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:47.144101    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-605142-5774f8954d-zc2wc"]
Jul 27 18:21:47.476699 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:21:47.476667    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e92f05fe-39e6-4f99-9a2e-513af65336a0" path="/var/lib/kubelet/pods/e92f05fe-39e6-4f99-9a2e-513af65336a0/volumes"
Jul 27 18:22:16.407733 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:16.407697    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"]
Jul 27 18:22:16.408321 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:16.407977    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c" podUID="be0c480a-0558-4efe-a07d-662074073cd9" containerName="payload-processing" containerID="cri-o://3d6a28442e2d9920616787bfbdc550bdd05fb8613220f043115c296b4a8881e1" gracePeriod=30
Jul 27 18:22:16.683177 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:16.683142    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"
Jul 27 18:22:16.763812 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:16.763770    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56xfd\" (UniqueName: \"kubernetes.io/projected/be0c480a-0558-4efe-a07d-662074073cd9-kube-api-access-56xfd\") pod \"be0c480a-0558-4efe-a07d-662074073cd9\" (UID: \"be0c480a-0558-4efe-a07d-662074073cd9\") "
Jul 27 18:22:16.764016 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:16.763834    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be0c480a-0558-4efe-a07d-662074073cd9-plugins-config-volume\") pod \"be0c480a-0558-4efe-a07d-662074073cd9\" (UID: \"be0c480a-0558-4efe-a07d-662074073cd9\") "
Jul 27 18:22:16.764238 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:16.764210    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be0c480a-0558-4efe-a07d-662074073cd9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "be0c480a-0558-4efe-a07d-662074073cd9" (UID: "be0c480a-0558-4efe-a07d-662074073cd9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:22:16.766055 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:16.766031    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be0c480a-0558-4efe-a07d-662074073cd9-kube-api-access-56xfd" (OuterVolumeSpecName: "kube-api-access-56xfd") pod "be0c480a-0558-4efe-a07d-662074073cd9" (UID: "be0c480a-0558-4efe-a07d-662074073cd9"). InnerVolumeSpecName "kube-api-access-56xfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:22:16.864711 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:16.864661    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56xfd\" (UniqueName: \"kubernetes.io/projected/be0c480a-0558-4efe-a07d-662074073cd9-kube-api-access-56xfd\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:22:16.864711 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:16.864703    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be0c480a-0558-4efe-a07d-662074073cd9-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:22:17.272094 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:17.272057    2580 generic.go:356] "Generic (PLEG): container finished" podID="be0c480a-0558-4efe-a07d-662074073cd9" containerID="3d6a28442e2d9920616787bfbdc550bdd05fb8613220f043115c296b4a8881e1" exitCode=0
Jul 27 18:22:17.272317 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:17.272110    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c" event={"ID":"be0c480a-0558-4efe-a07d-662074073cd9","Type":"ContainerDied","Data":"3d6a28442e2d9920616787bfbdc550bdd05fb8613220f043115c296b4a8881e1"}
Jul 27 18:22:17.272317 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:17.272118    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"
Jul 27 18:22:17.272317 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:17.272180    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c" event={"ID":"be0c480a-0558-4efe-a07d-662074073cd9","Type":"ContainerDied","Data":"704bda7151957e6c3a4475287f629748c65c9831ca4a6256bcca3f19faa752b1"}
Jul 27 18:22:17.272317 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:17.272202    2580 scope.go:117] "RemoveContainer" containerID="3d6a28442e2d9920616787bfbdc550bdd05fb8613220f043115c296b4a8881e1"
Jul 27 18:22:17.282035 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:17.282017    2580 scope.go:117] "RemoveContainer" containerID="3d6a28442e2d9920616787bfbdc550bdd05fb8613220f043115c296b4a8881e1"
Jul 27 18:22:17.282319 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:22:17.282299    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d6a28442e2d9920616787bfbdc550bdd05fb8613220f043115c296b4a8881e1\": container with ID starting with 3d6a28442e2d9920616787bfbdc550bdd05fb8613220f043115c296b4a8881e1 not found: ID does not exist" containerID="3d6a28442e2d9920616787bfbdc550bdd05fb8613220f043115c296b4a8881e1"
Jul 27 18:22:17.282361 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:17.282329    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d6a28442e2d9920616787bfbdc550bdd05fb8613220f043115c296b4a8881e1"} err="failed to get container status \"3d6a28442e2d9920616787bfbdc550bdd05fb8613220f043115c296b4a8881e1\": rpc error: code = NotFound desc = could not find container \"3d6a28442e2d9920616787bfbdc550bdd05fb8613220f043115c296b4a8881e1\": container with ID starting with 3d6a28442e2d9920616787bfbdc550bdd05fb8613220f043115c296b4a8881e1 not found: ID does not exist"
Jul 27 18:22:17.294949 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:17.294886    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"]
Jul 27 18:22:17.298108 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:17.298086    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f4a7a7-868d5649d-zg79c"]
Jul 27 18:22:17.477193 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:22:17.477161    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be0c480a-0558-4efe-a07d-662074073cd9" path="/var/lib/kubelet/pods/be0c480a-0558-4efe-a07d-662074073cd9/volumes"
Jul 27 18:23:23.595133 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:23.595097    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"]
Jul 27 18:23:23.595736 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:23.595317    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662" podUID="6c045999-2838-4ea2-ab35-69a2bf2a793e" containerName="istio-proxy" containerID="cri-o://7d5365219d9d27f418f7cf05ad9a79cf48a27660b9077e14bc616bcbfb16fddf" gracePeriod=30
Jul 27 18:23:28.846434 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.846403    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:23:28.980726 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.980692    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2f5v\" (UniqueName: \"kubernetes.io/projected/6c045999-2838-4ea2-ab35-69a2bf2a793e-kube-api-access-p2f5v\") pod \"6c045999-2838-4ea2-ab35-69a2bf2a793e\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") "
Jul 27 18:23:28.980726 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.980729    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-envoy\") pod \"6c045999-2838-4ea2-ab35-69a2bf2a793e\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") "
Jul 27 18:23:28.981004 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.980792    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-token\") pod \"6c045999-2838-4ea2-ab35-69a2bf2a793e\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") "
Jul 27 18:23:28.981004 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.980825    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-data\") pod \"6c045999-2838-4ea2-ab35-69a2bf2a793e\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") "
Jul 27 18:23:28.981004 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.980928    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-workload-socket\") pod \"6c045999-2838-4ea2-ab35-69a2bf2a793e\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") "
Jul 27 18:23:28.981004 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.980958    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-credential-socket\") pod \"6c045999-2838-4ea2-ab35-69a2bf2a793e\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") "
Jul 27 18:23:28.981004 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.980996    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c045999-2838-4ea2-ab35-69a2bf2a793e-istiod-ca-cert\") pod \"6c045999-2838-4ea2-ab35-69a2bf2a793e\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") "
Jul 27 18:23:28.981271 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.981030    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-podinfo\") pod \"6c045999-2838-4ea2-ab35-69a2bf2a793e\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") "
Jul 27 18:23:28.981271 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.981056    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-workload-certs\") pod \"6c045999-2838-4ea2-ab35-69a2bf2a793e\" (UID: \"6c045999-2838-4ea2-ab35-69a2bf2a793e\") "
Jul 27 18:23:28.981271 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.981194    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c045999-2838-4ea2-ab35-69a2bf2a793e" (UID: "6c045999-2838-4ea2-ab35-69a2bf2a793e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:23:28.981429 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.981414    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c045999-2838-4ea2-ab35-69a2bf2a793e" (UID: "6c045999-2838-4ea2-ab35-69a2bf2a793e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:23:28.981888 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.981478    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:23:28.981888 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.981611    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c045999-2838-4ea2-ab35-69a2bf2a793e" (UID: "6c045999-2838-4ea2-ab35-69a2bf2a793e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:23:28.981888 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.981839    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c045999-2838-4ea2-ab35-69a2bf2a793e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c045999-2838-4ea2-ab35-69a2bf2a793e" (UID: "6c045999-2838-4ea2-ab35-69a2bf2a793e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:23:28.982128 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.981874    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c045999-2838-4ea2-ab35-69a2bf2a793e" (UID: "6c045999-2838-4ea2-ab35-69a2bf2a793e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:23:28.983304 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.983272    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c045999-2838-4ea2-ab35-69a2bf2a793e-kube-api-access-p2f5v" (OuterVolumeSpecName: "kube-api-access-p2f5v") pod "6c045999-2838-4ea2-ab35-69a2bf2a793e" (UID: "6c045999-2838-4ea2-ab35-69a2bf2a793e"). InnerVolumeSpecName "kube-api-access-p2f5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:23:28.983436 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.983306    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c045999-2838-4ea2-ab35-69a2bf2a793e" (UID: "6c045999-2838-4ea2-ab35-69a2bf2a793e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:23:28.983436 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.983402    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c045999-2838-4ea2-ab35-69a2bf2a793e" (UID: "6c045999-2838-4ea2-ab35-69a2bf2a793e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:23:28.983749 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:28.983728    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c045999-2838-4ea2-ab35-69a2bf2a793e" (UID: "6c045999-2838-4ea2-ab35-69a2bf2a793e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 18:23:29.082048 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.082004    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:23:29.082048 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.082042    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:23:29.082048 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.082055    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:23:29.082305 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.082068    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c045999-2838-4ea2-ab35-69a2bf2a793e-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:23:29.082305 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.082079    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:23:29.082305 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.082089    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:23:29.082305 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.082101    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2f5v\" (UniqueName: \"kubernetes.io/projected/6c045999-2838-4ea2-ab35-69a2bf2a793e-kube-api-access-p2f5v\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:23:29.082305 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.082112    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c045999-2838-4ea2-ab35-69a2bf2a793e-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:23:29.663122 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.663079    2580 generic.go:356] "Generic (PLEG): container finished" podID="6c045999-2838-4ea2-ab35-69a2bf2a793e" containerID="7d5365219d9d27f418f7cf05ad9a79cf48a27660b9077e14bc616bcbfb16fddf" exitCode=0
Jul 27 18:23:29.663307 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.663143    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"
Jul 27 18:23:29.663307 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.663164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662" event={"ID":"6c045999-2838-4ea2-ab35-69a2bf2a793e","Type":"ContainerDied","Data":"7d5365219d9d27f418f7cf05ad9a79cf48a27660b9077e14bc616bcbfb16fddf"}
Jul 27 18:23:29.663307 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.663223    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662" event={"ID":"6c045999-2838-4ea2-ab35-69a2bf2a793e","Type":"ContainerDied","Data":"f804d2808abda53f690686ce51e41fa1b1bb92e4c2fa6643837cd875d2216788"}
Jul 27 18:23:29.663307 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.663248    2580 scope.go:117] "RemoveContainer" containerID="7d5365219d9d27f418f7cf05ad9a79cf48a27660b9077e14bc616bcbfb16fddf"
Jul 27 18:23:29.673059 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.673037    2580 scope.go:117] "RemoveContainer" containerID="2e9b58e0e4d9e3ba9d62a6aa7ea33cdf8bf82e62682a9cfc4f2a17f200aa1212"
Jul 27 18:23:29.681388 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.681368    2580 scope.go:117] "RemoveContainer" containerID="7d5365219d9d27f418f7cf05ad9a79cf48a27660b9077e14bc616bcbfb16fddf"
Jul 27 18:23:29.681759 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:23:29.681736    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d5365219d9d27f418f7cf05ad9a79cf48a27660b9077e14bc616bcbfb16fddf\": container with ID starting with 7d5365219d9d27f418f7cf05ad9a79cf48a27660b9077e14bc616bcbfb16fddf not found: ID does not exist" containerID="7d5365219d9d27f418f7cf05ad9a79cf48a27660b9077e14bc616bcbfb16fddf"
Jul 27 18:23:29.681856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.681769    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d5365219d9d27f418f7cf05ad9a79cf48a27660b9077e14bc616bcbfb16fddf"} err="failed to get container status \"7d5365219d9d27f418f7cf05ad9a79cf48a27660b9077e14bc616bcbfb16fddf\": rpc error: code = NotFound desc = could not find container \"7d5365219d9d27f418f7cf05ad9a79cf48a27660b9077e14bc616bcbfb16fddf\": container with ID starting with 7d5365219d9d27f418f7cf05ad9a79cf48a27660b9077e14bc616bcbfb16fddf not found: ID does not exist"
Jul 27 18:23:29.681856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.681788    2580 scope.go:117] "RemoveContainer" containerID="2e9b58e0e4d9e3ba9d62a6aa7ea33cdf8bf82e62682a9cfc4f2a17f200aa1212"
Jul 27 18:23:29.681856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.681821    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"]
Jul 27 18:23:29.682180 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:23:29.682146    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e9b58e0e4d9e3ba9d62a6aa7ea33cdf8bf82e62682a9cfc4f2a17f200aa1212\": container with ID starting with 2e9b58e0e4d9e3ba9d62a6aa7ea33cdf8bf82e62682a9cfc4f2a17f200aa1212 not found: ID does not exist" containerID="2e9b58e0e4d9e3ba9d62a6aa7ea33cdf8bf82e62682a9cfc4f2a17f200aa1212"
Jul 27 18:23:29.682286 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.682181    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e9b58e0e4d9e3ba9d62a6aa7ea33cdf8bf82e62682a9cfc4f2a17f200aa1212"} err="failed to get container status \"2e9b58e0e4d9e3ba9d62a6aa7ea33cdf8bf82e62682a9cfc4f2a17f200aa1212\": rpc error: code = NotFound desc = could not find container \"2e9b58e0e4d9e3ba9d62a6aa7ea33cdf8bf82e62682a9cfc4f2a17f200aa1212\": container with ID starting with 2e9b58e0e4d9e3ba9d62a6aa7ea33cdf8bf82e62682a9cfc4f2a17f200aa1212 not found: ID does not exist"
Jul 27 18:23:29.685259 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:29.685238    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-f4a7a7-openshift-default-fc557fd8b-wk662"]
Jul 27 18:23:31.477021 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:31.476984    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c045999-2838-4ea2-ab35-69a2bf2a793e" path="/var/lib/kubelet/pods/6c045999-2838-4ea2-ab35-69a2bf2a793e/volumes"
Jul 27 18:23:34.452894 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:34.452861    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"]
Jul 27 18:23:34.453397 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:34.453108    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw" podUID="6e5c2fc4-b88b-4a96-a608-38b3a46ced57" containerName="payload-processing" containerID="cri-o://bfd46294b89b4172fa37ccc28f3ae24ec4f340939d06ad4ef5654cc87e9d9ed0" gracePeriod=30
Jul 27 18:23:34.692215 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:34.692183    2580 generic.go:356] "Generic (PLEG): container finished" podID="6e5c2fc4-b88b-4a96-a608-38b3a46ced57" containerID="bfd46294b89b4172fa37ccc28f3ae24ec4f340939d06ad4ef5654cc87e9d9ed0" exitCode=0
Jul 27 18:23:34.692396 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:34.692234    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw" event={"ID":"6e5c2fc4-b88b-4a96-a608-38b3a46ced57","Type":"ContainerDied","Data":"bfd46294b89b4172fa37ccc28f3ae24ec4f340939d06ad4ef5654cc87e9d9ed0"}
Jul 27 18:23:34.735215 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:34.735123    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"
Jul 27 18:23:34.834763 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:34.834714    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e5c2fc4-b88b-4a96-a608-38b3a46ced57-plugins-config-volume\") pod \"6e5c2fc4-b88b-4a96-a608-38b3a46ced57\" (UID: \"6e5c2fc4-b88b-4a96-a608-38b3a46ced57\") "
Jul 27 18:23:34.834966 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:34.834792    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvbpv\" (UniqueName: \"kubernetes.io/projected/6e5c2fc4-b88b-4a96-a608-38b3a46ced57-kube-api-access-bvbpv\") pod \"6e5c2fc4-b88b-4a96-a608-38b3a46ced57\" (UID: \"6e5c2fc4-b88b-4a96-a608-38b3a46ced57\") "
Jul 27 18:23:34.835126 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:34.835099    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e5c2fc4-b88b-4a96-a608-38b3a46ced57-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6e5c2fc4-b88b-4a96-a608-38b3a46ced57" (UID: "6e5c2fc4-b88b-4a96-a608-38b3a46ced57"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:23:34.836850 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:34.836790    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e5c2fc4-b88b-4a96-a608-38b3a46ced57-kube-api-access-bvbpv" (OuterVolumeSpecName: "kube-api-access-bvbpv") pod "6e5c2fc4-b88b-4a96-a608-38b3a46ced57" (UID: "6e5c2fc4-b88b-4a96-a608-38b3a46ced57"). InnerVolumeSpecName "kube-api-access-bvbpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:23:34.935952 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:34.935891    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvbpv\" (UniqueName: \"kubernetes.io/projected/6e5c2fc4-b88b-4a96-a608-38b3a46ced57-kube-api-access-bvbpv\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:23:34.935952 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:34.935940    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e5c2fc4-b88b-4a96-a608-38b3a46ced57-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:23:35.699406 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:35.699370    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw" event={"ID":"6e5c2fc4-b88b-4a96-a608-38b3a46ced57","Type":"ContainerDied","Data":"3b777411c355578eae61e3f6c8b742980d370faae3985f4144b790d9c2fcec2f"}
Jul 27 18:23:35.699861 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:35.699414    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"
Jul 27 18:23:35.699861 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:35.699443    2580 scope.go:117] "RemoveContainer" containerID="bfd46294b89b4172fa37ccc28f3ae24ec4f340939d06ad4ef5654cc87e9d9ed0"
Jul 27 18:23:35.730867 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:35.730828    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"]
Jul 27 18:23:35.737750 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:35.737690    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-5cb9b7-dd448b7f6-72lrw"]
Jul 27 18:23:37.476699 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:37.476664    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e5c2fc4-b88b-4a96-a608-38b3a46ced57" path="/var/lib/kubelet/pods/6e5c2fc4-b88b-4a96-a608-38b3a46ced57/volumes"
Jul 27 18:23:56.118883 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.118849    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"]
Jul 27 18:23:56.119498 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.119110    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw" podUID="63fce40f-b233-4412-9139-4e0eab0ce763" containerName="payload-processing" containerID="cri-o://158ba2a8210921bed196a9f04565784f27c81dcf6603c8ca62b28697fba3e816" gracePeriod=30
Jul 27 18:23:56.125111 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.125081    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"]
Jul 27 18:23:56.125385 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.125353    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv" podUID="961f46af-2baf-4a36-a751-67077405d442" containerName="payload-pre-processing" containerID="cri-o://def742f5aa552cfcccb0a0c5ba0d7f53642bbde2d20b6eaea87865869e625e52" gracePeriod=30
Jul 27 18:23:56.394540 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.394514    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"
Jul 27 18:23:56.426330 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.426306    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"
Jul 27 18:23:56.547678 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.547643    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkbmf\" (UniqueName: \"kubernetes.io/projected/961f46af-2baf-4a36-a751-67077405d442-kube-api-access-zkbmf\") pod \"961f46af-2baf-4a36-a751-67077405d442\" (UID: \"961f46af-2baf-4a36-a751-67077405d442\") "
Jul 27 18:23:56.547866 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.547696    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhrfq\" (UniqueName: \"kubernetes.io/projected/63fce40f-b233-4412-9139-4e0eab0ce763-kube-api-access-vhrfq\") pod \"63fce40f-b233-4412-9139-4e0eab0ce763\" (UID: \"63fce40f-b233-4412-9139-4e0eab0ce763\") "
Jul 27 18:23:56.547866 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.547761    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63fce40f-b233-4412-9139-4e0eab0ce763-plugins-config-volume\") pod \"63fce40f-b233-4412-9139-4e0eab0ce763\" (UID: \"63fce40f-b233-4412-9139-4e0eab0ce763\") "
Jul 27 18:23:56.547866 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.547805    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/961f46af-2baf-4a36-a751-67077405d442-plugins-config-volume\") pod \"961f46af-2baf-4a36-a751-67077405d442\" (UID: \"961f46af-2baf-4a36-a751-67077405d442\") "
Jul 27 18:23:56.548214 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.548167    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63fce40f-b233-4412-9139-4e0eab0ce763-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "63fce40f-b233-4412-9139-4e0eab0ce763" (UID: "63fce40f-b233-4412-9139-4e0eab0ce763"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:23:56.548353 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.548236    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/961f46af-2baf-4a36-a751-67077405d442-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "961f46af-2baf-4a36-a751-67077405d442" (UID: "961f46af-2baf-4a36-a751-67077405d442"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:23:56.550362 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.550340    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63fce40f-b233-4412-9139-4e0eab0ce763-kube-api-access-vhrfq" (OuterVolumeSpecName: "kube-api-access-vhrfq") pod "63fce40f-b233-4412-9139-4e0eab0ce763" (UID: "63fce40f-b233-4412-9139-4e0eab0ce763"). InnerVolumeSpecName "kube-api-access-vhrfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:23:56.550469 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.550371    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/961f46af-2baf-4a36-a751-67077405d442-kube-api-access-zkbmf" (OuterVolumeSpecName: "kube-api-access-zkbmf") pod "961f46af-2baf-4a36-a751-67077405d442" (UID: "961f46af-2baf-4a36-a751-67077405d442"). InnerVolumeSpecName "kube-api-access-zkbmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:23:56.649252 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.649170    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/961f46af-2baf-4a36-a751-67077405d442-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:23:56.649252 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.649199    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkbmf\" (UniqueName: \"kubernetes.io/projected/961f46af-2baf-4a36-a751-67077405d442-kube-api-access-zkbmf\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:23:56.649252 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.649210    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhrfq\" (UniqueName: \"kubernetes.io/projected/63fce40f-b233-4412-9139-4e0eab0ce763-kube-api-access-vhrfq\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:23:56.649252 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.649219    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63fce40f-b233-4412-9139-4e0eab0ce763-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:23:56.811033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.810995    2580 generic.go:356] "Generic (PLEG): container finished" podID="63fce40f-b233-4412-9139-4e0eab0ce763" containerID="158ba2a8210921bed196a9f04565784f27c81dcf6603c8ca62b28697fba3e816" exitCode=0
Jul 27 18:23:56.811245 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.811044    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"
Jul 27 18:23:56.811245 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.811077    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw" event={"ID":"63fce40f-b233-4412-9139-4e0eab0ce763","Type":"ContainerDied","Data":"158ba2a8210921bed196a9f04565784f27c81dcf6603c8ca62b28697fba3e816"}
Jul 27 18:23:56.811245 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.811131    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw" event={"ID":"63fce40f-b233-4412-9139-4e0eab0ce763","Type":"ContainerDied","Data":"6b11556979a63a117e5e2c46aea5b42cd661b679b670afe9157d04147a8d5886"}
Jul 27 18:23:56.811245 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.811156    2580 scope.go:117] "RemoveContainer" containerID="158ba2a8210921bed196a9f04565784f27c81dcf6603c8ca62b28697fba3e816"
Jul 27 18:23:56.812575 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.812539    2580 generic.go:356] "Generic (PLEG): container finished" podID="961f46af-2baf-4a36-a751-67077405d442" containerID="def742f5aa552cfcccb0a0c5ba0d7f53642bbde2d20b6eaea87865869e625e52" exitCode=0
Jul 27 18:23:56.812575 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.812571    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"
Jul 27 18:23:56.812781 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.812633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv" event={"ID":"961f46af-2baf-4a36-a751-67077405d442","Type":"ContainerDied","Data":"def742f5aa552cfcccb0a0c5ba0d7f53642bbde2d20b6eaea87865869e625e52"}
Jul 27 18:23:56.812781 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.812692    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv" event={"ID":"961f46af-2baf-4a36-a751-67077405d442","Type":"ContainerDied","Data":"17509fd0268730c07375394427b2fc7492740c50f9fd92089e85089dfab3e6c1"}
Jul 27 18:23:56.821759 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.821715    2580 scope.go:117] "RemoveContainer" containerID="158ba2a8210921bed196a9f04565784f27c81dcf6603c8ca62b28697fba3e816"
Jul 27 18:23:56.822856 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:23:56.822407    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"158ba2a8210921bed196a9f04565784f27c81dcf6603c8ca62b28697fba3e816\": container with ID starting with 158ba2a8210921bed196a9f04565784f27c81dcf6603c8ca62b28697fba3e816 not found: ID does not exist" containerID="158ba2a8210921bed196a9f04565784f27c81dcf6603c8ca62b28697fba3e816"
Jul 27 18:23:56.822856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.822443    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"158ba2a8210921bed196a9f04565784f27c81dcf6603c8ca62b28697fba3e816"} err="failed to get container status \"158ba2a8210921bed196a9f04565784f27c81dcf6603c8ca62b28697fba3e816\": rpc error: code = NotFound desc = could not find container \"158ba2a8210921bed196a9f04565784f27c81dcf6603c8ca62b28697fba3e816\": container with ID starting with 158ba2a8210921bed196a9f04565784f27c81dcf6603c8ca62b28697fba3e816 not found: ID does not exist"
Jul 27 18:23:56.822856 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.822477    2580 scope.go:117] "RemoveContainer" containerID="def742f5aa552cfcccb0a0c5ba0d7f53642bbde2d20b6eaea87865869e625e52"
Jul 27 18:23:56.836269 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.836249    2580 scope.go:117] "RemoveContainer" containerID="def742f5aa552cfcccb0a0c5ba0d7f53642bbde2d20b6eaea87865869e625e52"
Jul 27 18:23:56.836552 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:23:56.836530    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"def742f5aa552cfcccb0a0c5ba0d7f53642bbde2d20b6eaea87865869e625e52\": container with ID starting with def742f5aa552cfcccb0a0c5ba0d7f53642bbde2d20b6eaea87865869e625e52 not found: ID does not exist" containerID="def742f5aa552cfcccb0a0c5ba0d7f53642bbde2d20b6eaea87865869e625e52"
Jul 27 18:23:56.836661 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.836560    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"def742f5aa552cfcccb0a0c5ba0d7f53642bbde2d20b6eaea87865869e625e52"} err="failed to get container status \"def742f5aa552cfcccb0a0c5ba0d7f53642bbde2d20b6eaea87865869e625e52\": rpc error: code = NotFound desc = could not find container \"def742f5aa552cfcccb0a0c5ba0d7f53642bbde2d20b6eaea87865869e625e52\": container with ID starting with def742f5aa552cfcccb0a0c5ba0d7f53642bbde2d20b6eaea87865869e625e52 not found: ID does not exist"
Jul 27 18:23:56.841793 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.841768    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"]
Jul 27 18:23:56.846976 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.846955    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-addd0c-6f8fc58b86-b5wzw"]
Jul 27 18:23:56.856725 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.856705    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"]
Jul 27 18:23:56.860658 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:56.860638    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-addd0c-df9d6b4d-xdcdv"]
Jul 27 18:23:57.476349 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:57.476314    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63fce40f-b233-4412-9139-4e0eab0ce763" path="/var/lib/kubelet/pods/63fce40f-b233-4412-9139-4e0eab0ce763/volumes"
Jul 27 18:23:57.476746 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:23:57.476698    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="961f46af-2baf-4a36-a751-67077405d442" path="/var/lib/kubelet/pods/961f46af-2baf-4a36-a751-67077405d442/volumes"
Jul 27 18:24:07.239601 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:07.239547    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"]
Jul 27 18:24:07.240129 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:07.239831    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8" podUID="3d4c16df-e246-45da-8cbd-84ee0c04f24a" containerName="istio-proxy" containerID="cri-o://ecd7ced47bd02c66dec35946b47d01785b74ef3dc8bab251939c7caa79f4a019" gracePeriod=30
Jul 27 18:24:12.501144 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.501113    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:24:12.591287 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.591187    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-credential-socket\") pod \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") "
Jul 27 18:24:12.591287 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.591247    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr9xx\" (UniqueName: \"kubernetes.io/projected/3d4c16df-e246-45da-8cbd-84ee0c04f24a-kube-api-access-gr9xx\") pod \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") "
Jul 27 18:24:12.591287 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.591269    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-token\") pod \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") "
Jul 27 18:24:12.591617 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.591301    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-data\") pod \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") "
Jul 27 18:24:12.591617 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.591340    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istiod-ca-cert\") pod \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") "
Jul 27 18:24:12.591617 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.591380    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-workload-socket\") pod \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") "
Jul 27 18:24:12.591617 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.591411    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-workload-certs\") pod \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") "
Jul 27 18:24:12.591617 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.591437    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-podinfo\") pod \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") "
Jul 27 18:24:12.591617 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.591466    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-envoy\") pod \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\" (UID: \"3d4c16df-e246-45da-8cbd-84ee0c04f24a\") "
Jul 27 18:24:12.591617 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.591508    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d4c16df-e246-45da-8cbd-84ee0c04f24a" (UID: "3d4c16df-e246-45da-8cbd-84ee0c04f24a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:24:12.591961 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.591753    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d4c16df-e246-45da-8cbd-84ee0c04f24a" (UID: "3d4c16df-e246-45da-8cbd-84ee0c04f24a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:24:12.591961 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.591769    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d4c16df-e246-45da-8cbd-84ee0c04f24a" (UID: "3d4c16df-e246-45da-8cbd-84ee0c04f24a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:24:12.591961 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.591845    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:12.591961 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.591865    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:12.591961 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.591880    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:12.592192 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.592074    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d4c16df-e246-45da-8cbd-84ee0c04f24a" (UID: "3d4c16df-e246-45da-8cbd-84ee0c04f24a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:24:12.592277 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.592241    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d4c16df-e246-45da-8cbd-84ee0c04f24a" (UID: "3d4c16df-e246-45da-8cbd-84ee0c04f24a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:24:12.593534 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.593508    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d4c16df-e246-45da-8cbd-84ee0c04f24a-kube-api-access-gr9xx" (OuterVolumeSpecName: "kube-api-access-gr9xx") pod "3d4c16df-e246-45da-8cbd-84ee0c04f24a" (UID: "3d4c16df-e246-45da-8cbd-84ee0c04f24a"). InnerVolumeSpecName "kube-api-access-gr9xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:24:12.593798 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.593781    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d4c16df-e246-45da-8cbd-84ee0c04f24a" (UID: "3d4c16df-e246-45da-8cbd-84ee0c04f24a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:24:12.593935 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.593911    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d4c16df-e246-45da-8cbd-84ee0c04f24a" (UID: "3d4c16df-e246-45da-8cbd-84ee0c04f24a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 18:24:12.593983 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.593968    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d4c16df-e246-45da-8cbd-84ee0c04f24a" (UID: "3d4c16df-e246-45da-8cbd-84ee0c04f24a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:24:12.692950 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.692909    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:12.692950 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.692946    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:12.692950 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.692958    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr9xx\" (UniqueName: \"kubernetes.io/projected/3d4c16df-e246-45da-8cbd-84ee0c04f24a-kube-api-access-gr9xx\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:12.692950 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.692968    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:12.693234 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.692977    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:12.693234 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.692985    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d4c16df-e246-45da-8cbd-84ee0c04f24a-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:12.895930 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.895832    2580 generic.go:356] "Generic (PLEG): container finished" podID="3d4c16df-e246-45da-8cbd-84ee0c04f24a" containerID="ecd7ced47bd02c66dec35946b47d01785b74ef3dc8bab251939c7caa79f4a019" exitCode=0
Jul 27 18:24:12.895930 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.895894    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"
Jul 27 18:24:12.895930 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.895901    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8" event={"ID":"3d4c16df-e246-45da-8cbd-84ee0c04f24a","Type":"ContainerDied","Data":"ecd7ced47bd02c66dec35946b47d01785b74ef3dc8bab251939c7caa79f4a019"}
Jul 27 18:24:12.896202 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.895956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8" event={"ID":"3d4c16df-e246-45da-8cbd-84ee0c04f24a","Type":"ContainerDied","Data":"1f0368ca1cab7ca330017a04c3cdc1ff9c74458e2f565c63492d1ff427e6cdca"}
Jul 27 18:24:12.896202 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.895987    2580 scope.go:117] "RemoveContainer" containerID="ecd7ced47bd02c66dec35946b47d01785b74ef3dc8bab251939c7caa79f4a019"
Jul 27 18:24:12.905850 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.905832    2580 scope.go:117] "RemoveContainer" containerID="e2db9d3f77b4339521494c292a5bdd0a74586abcbc08b91ed9a6dae1c91dd9fd"
Jul 27 18:24:12.914067 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.914050    2580 scope.go:117] "RemoveContainer" containerID="ecd7ced47bd02c66dec35946b47d01785b74ef3dc8bab251939c7caa79f4a019"
Jul 27 18:24:12.914391 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:24:12.914368    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecd7ced47bd02c66dec35946b47d01785b74ef3dc8bab251939c7caa79f4a019\": container with ID starting with ecd7ced47bd02c66dec35946b47d01785b74ef3dc8bab251939c7caa79f4a019 not found: ID does not exist" containerID="ecd7ced47bd02c66dec35946b47d01785b74ef3dc8bab251939c7caa79f4a019"
Jul 27 18:24:12.914472 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.914398    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecd7ced47bd02c66dec35946b47d01785b74ef3dc8bab251939c7caa79f4a019"} err="failed to get container status \"ecd7ced47bd02c66dec35946b47d01785b74ef3dc8bab251939c7caa79f4a019\": rpc error: code = NotFound desc = could not find container \"ecd7ced47bd02c66dec35946b47d01785b74ef3dc8bab251939c7caa79f4a019\": container with ID starting with ecd7ced47bd02c66dec35946b47d01785b74ef3dc8bab251939c7caa79f4a019 not found: ID does not exist"
Jul 27 18:24:12.914472 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.914418    2580 scope.go:117] "RemoveContainer" containerID="e2db9d3f77b4339521494c292a5bdd0a74586abcbc08b91ed9a6dae1c91dd9fd"
Jul 27 18:24:12.914744 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:24:12.914717    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2db9d3f77b4339521494c292a5bdd0a74586abcbc08b91ed9a6dae1c91dd9fd\": container with ID starting with e2db9d3f77b4339521494c292a5bdd0a74586abcbc08b91ed9a6dae1c91dd9fd not found: ID does not exist" containerID="e2db9d3f77b4339521494c292a5bdd0a74586abcbc08b91ed9a6dae1c91dd9fd"
Jul 27 18:24:12.914890 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.914749    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2db9d3f77b4339521494c292a5bdd0a74586abcbc08b91ed9a6dae1c91dd9fd"} err="failed to get container status \"e2db9d3f77b4339521494c292a5bdd0a74586abcbc08b91ed9a6dae1c91dd9fd\": rpc error: code = NotFound desc = could not find container \"e2db9d3f77b4339521494c292a5bdd0a74586abcbc08b91ed9a6dae1c91dd9fd\": container with ID starting with e2db9d3f77b4339521494c292a5bdd0a74586abcbc08b91ed9a6dae1c91dd9fd not found: ID does not exist"
Jul 27 18:24:12.917080 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.917058    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"]
Jul 27 18:24:12.923238 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:12.923216    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-addd0c-openshift-default-799f74755b-xqll8"]
Jul 27 18:24:13.476638 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:13.476601    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d4c16df-e246-45da-8cbd-84ee0c04f24a" path="/var/lib/kubelet/pods/3d4c16df-e246-45da-8cbd-84ee0c04f24a/volumes"
Jul 27 18:24:18.031279 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.031238    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"]
Jul 27 18:24:18.031736 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.031499    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq" podUID="a2720560-8b48-45bf-a885-d0d507cd7764" containerName="payload-processing" containerID="cri-o://11ef36babf901ad59cc9a03ac8d08c1ca86b61813e14c8762470f04ed6c9ae53" gracePeriod=30
Jul 27 18:24:18.038908 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.038722    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"]
Jul 27 18:24:18.039741 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.039689    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv" podUID="7b0a49bf-bc54-4a7a-acd2-5911e294ac29" containerName="payload-pre-processing" containerID="cri-o://2c6c63151c1ed787af6e9fe6ba8d6d223c226e99b3b9a4dbcf26e245ef901f44" gracePeriod=30
Jul 27 18:24:18.312982 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.312953    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"
Jul 27 18:24:18.344450 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.344419    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2wg6\" (UniqueName: \"kubernetes.io/projected/a2720560-8b48-45bf-a885-d0d507cd7764-kube-api-access-n2wg6\") pod \"a2720560-8b48-45bf-a885-d0d507cd7764\" (UID: \"a2720560-8b48-45bf-a885-d0d507cd7764\") "
Jul 27 18:24:18.344646 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.344554    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2720560-8b48-45bf-a885-d0d507cd7764-plugins-config-volume\") pod \"a2720560-8b48-45bf-a885-d0d507cd7764\" (UID: \"a2720560-8b48-45bf-a885-d0d507cd7764\") "
Jul 27 18:24:18.344982 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.344952    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2720560-8b48-45bf-a885-d0d507cd7764-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a2720560-8b48-45bf-a885-d0d507cd7764" (UID: "a2720560-8b48-45bf-a885-d0d507cd7764"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:24:18.346728 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.346699    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2720560-8b48-45bf-a885-d0d507cd7764-kube-api-access-n2wg6" (OuterVolumeSpecName: "kube-api-access-n2wg6") pod "a2720560-8b48-45bf-a885-d0d507cd7764" (UID: "a2720560-8b48-45bf-a885-d0d507cd7764"). InnerVolumeSpecName "kube-api-access-n2wg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:24:18.351771 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.351748    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"
Jul 27 18:24:18.445860 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.445826    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0a49bf-bc54-4a7a-acd2-5911e294ac29-plugins-config-volume\") pod \"7b0a49bf-bc54-4a7a-acd2-5911e294ac29\" (UID: \"7b0a49bf-bc54-4a7a-acd2-5911e294ac29\") "
Jul 27 18:24:18.446038 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.445950    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtcm7\" (UniqueName: \"kubernetes.io/projected/7b0a49bf-bc54-4a7a-acd2-5911e294ac29-kube-api-access-mtcm7\") pod \"7b0a49bf-bc54-4a7a-acd2-5911e294ac29\" (UID: \"7b0a49bf-bc54-4a7a-acd2-5911e294ac29\") "
Jul 27 18:24:18.446228 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.446211    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2wg6\" (UniqueName: \"kubernetes.io/projected/a2720560-8b48-45bf-a885-d0d507cd7764-kube-api-access-n2wg6\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:18.446272 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.446238    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2720560-8b48-45bf-a885-d0d507cd7764-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:18.446272 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.446245    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b0a49bf-bc54-4a7a-acd2-5911e294ac29-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b0a49bf-bc54-4a7a-acd2-5911e294ac29" (UID: "7b0a49bf-bc54-4a7a-acd2-5911e294ac29"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:24:18.447962 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.447937    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b0a49bf-bc54-4a7a-acd2-5911e294ac29-kube-api-access-mtcm7" (OuterVolumeSpecName: "kube-api-access-mtcm7") pod "7b0a49bf-bc54-4a7a-acd2-5911e294ac29" (UID: "7b0a49bf-bc54-4a7a-acd2-5911e294ac29"). InnerVolumeSpecName "kube-api-access-mtcm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:24:18.547033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.546941    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtcm7\" (UniqueName: \"kubernetes.io/projected/7b0a49bf-bc54-4a7a-acd2-5911e294ac29-kube-api-access-mtcm7\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:18.547033 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.546977    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b0a49bf-bc54-4a7a-acd2-5911e294ac29-plugins-config-volume\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:18.928539 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.928506    2580 generic.go:356] "Generic (PLEG): container finished" podID="7b0a49bf-bc54-4a7a-acd2-5911e294ac29" containerID="2c6c63151c1ed787af6e9fe6ba8d6d223c226e99b3b9a4dbcf26e245ef901f44" exitCode=0
Jul 27 18:24:18.928738 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.928547    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"
Jul 27 18:24:18.928738 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.928616    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv" event={"ID":"7b0a49bf-bc54-4a7a-acd2-5911e294ac29","Type":"ContainerDied","Data":"2c6c63151c1ed787af6e9fe6ba8d6d223c226e99b3b9a4dbcf26e245ef901f44"}
Jul 27 18:24:18.928738 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.928665    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv" event={"ID":"7b0a49bf-bc54-4a7a-acd2-5911e294ac29","Type":"ContainerDied","Data":"8952436a864f9872b7aa8b5f5de77362b4e4643bb6ae6ccc1af85fabe9f73bfa"}
Jul 27 18:24:18.928738 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.928691    2580 scope.go:117] "RemoveContainer" containerID="2c6c63151c1ed787af6e9fe6ba8d6d223c226e99b3b9a4dbcf26e245ef901f44"
Jul 27 18:24:18.930116 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.930096    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2720560-8b48-45bf-a885-d0d507cd7764" containerID="11ef36babf901ad59cc9a03ac8d08c1ca86b61813e14c8762470f04ed6c9ae53" exitCode=0
Jul 27 18:24:18.930226 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.930125    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq" event={"ID":"a2720560-8b48-45bf-a885-d0d507cd7764","Type":"ContainerDied","Data":"11ef36babf901ad59cc9a03ac8d08c1ca86b61813e14c8762470f04ed6c9ae53"}
Jul 27 18:24:18.930226 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.930156    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"
Jul 27 18:24:18.930226 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.930160    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq" event={"ID":"a2720560-8b48-45bf-a885-d0d507cd7764","Type":"ContainerDied","Data":"08f60124eec4dc38c9d8a9c75434a6a6ad072baab81effee7fec37f5853ad417"}
Jul 27 18:24:18.937269 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.937251    2580 scope.go:117] "RemoveContainer" containerID="2c6c63151c1ed787af6e9fe6ba8d6d223c226e99b3b9a4dbcf26e245ef901f44"
Jul 27 18:24:18.937605 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:24:18.937558    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c6c63151c1ed787af6e9fe6ba8d6d223c226e99b3b9a4dbcf26e245ef901f44\": container with ID starting with 2c6c63151c1ed787af6e9fe6ba8d6d223c226e99b3b9a4dbcf26e245ef901f44 not found: ID does not exist" containerID="2c6c63151c1ed787af6e9fe6ba8d6d223c226e99b3b9a4dbcf26e245ef901f44"
Jul 27 18:24:18.937714 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.937615    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c6c63151c1ed787af6e9fe6ba8d6d223c226e99b3b9a4dbcf26e245ef901f44"} err="failed to get container status \"2c6c63151c1ed787af6e9fe6ba8d6d223c226e99b3b9a4dbcf26e245ef901f44\": rpc error: code = NotFound desc = could not find container \"2c6c63151c1ed787af6e9fe6ba8d6d223c226e99b3b9a4dbcf26e245ef901f44\": container with ID starting with 2c6c63151c1ed787af6e9fe6ba8d6d223c226e99b3b9a4dbcf26e245ef901f44 not found: ID does not exist"
Jul 27 18:24:18.937714 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.937634    2580 scope.go:117] "RemoveContainer" containerID="11ef36babf901ad59cc9a03ac8d08c1ca86b61813e14c8762470f04ed6c9ae53"
Jul 27 18:24:18.946134 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.946116    2580 scope.go:117] "RemoveContainer" containerID="11ef36babf901ad59cc9a03ac8d08c1ca86b61813e14c8762470f04ed6c9ae53"
Jul 27 18:24:18.946390 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:24:18.946368    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11ef36babf901ad59cc9a03ac8d08c1ca86b61813e14c8762470f04ed6c9ae53\": container with ID starting with 11ef36babf901ad59cc9a03ac8d08c1ca86b61813e14c8762470f04ed6c9ae53 not found: ID does not exist" containerID="11ef36babf901ad59cc9a03ac8d08c1ca86b61813e14c8762470f04ed6c9ae53"
Jul 27 18:24:18.946480 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.946400    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11ef36babf901ad59cc9a03ac8d08c1ca86b61813e14c8762470f04ed6c9ae53"} err="failed to get container status \"11ef36babf901ad59cc9a03ac8d08c1ca86b61813e14c8762470f04ed6c9ae53\": rpc error: code = NotFound desc = could not find container \"11ef36babf901ad59cc9a03ac8d08c1ca86b61813e14c8762470f04ed6c9ae53\": container with ID starting with 11ef36babf901ad59cc9a03ac8d08c1ca86b61813e14c8762470f04ed6c9ae53 not found: ID does not exist"
Jul 27 18:24:18.956612 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.953089    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"]
Jul 27 18:24:18.962429 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.962405    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1706dd-75c6c49b96-9czfv"]
Jul 27 18:24:18.972274 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.972250    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"]
Jul 27 18:24:18.974475 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:18.974455    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1706dd-85697d758-nsdhq"]
Jul 27 18:24:19.476268 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:19.476231    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b0a49bf-bc54-4a7a-acd2-5911e294ac29" path="/var/lib/kubelet/pods/7b0a49bf-bc54-4a7a-acd2-5911e294ac29/volumes"
Jul 27 18:24:19.476700 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:19.476681    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2720560-8b48-45bf-a885-d0d507cd7764" path="/var/lib/kubelet/pods/a2720560-8b48-45bf-a885-d0d507cd7764/volumes"
Jul 27 18:24:29.350364 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:29.350328    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"]
Jul 27 18:24:29.350976 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:29.350613    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh" podUID="bbffef17-65dc-45ac-bb0f-d4a4bab3829d" containerName="istio-proxy" containerID="cri-o://21121363ace5098618fbf7e291a129682ff0beba215c30977111568a31cd300f" gracePeriod=30
Jul 27 18:24:34.592704 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.592679    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:24:34.690345 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.690312    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-workload-socket\") pod \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") "
Jul 27 18:24:34.690551 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.690352    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-envoy\") pod \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") "
Jul 27 18:24:34.690551 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.690409    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-workload-certs\") pod \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") "
Jul 27 18:24:34.690551 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.690460    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istiod-ca-cert\") pod \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") "
Jul 27 18:24:34.690551 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.690498    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-data\") pod \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") "
Jul 27 18:24:34.690551 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.690527    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-credential-socket\") pod \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") "
Jul 27 18:24:34.690842 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.690555    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mthr\" (UniqueName: \"kubernetes.io/projected/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-kube-api-access-4mthr\") pod \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") "
Jul 27 18:24:34.690842 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.690625    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-token\") pod \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") "
Jul 27 18:24:34.690842 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.690644    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bbffef17-65dc-45ac-bb0f-d4a4bab3829d" (UID: "bbffef17-65dc-45ac-bb0f-d4a4bab3829d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:24:34.690842 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.690674    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-podinfo\") pod \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\" (UID: \"bbffef17-65dc-45ac-bb0f-d4a4bab3829d\") "
Jul 27 18:24:34.690842 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.690828    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bbffef17-65dc-45ac-bb0f-d4a4bab3829d" (UID: "bbffef17-65dc-45ac-bb0f-d4a4bab3829d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:24:34.691110 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.690838    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bbffef17-65dc-45ac-bb0f-d4a4bab3829d" (UID: "bbffef17-65dc-45ac-bb0f-d4a4bab3829d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:24:34.691110 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.690867    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bbffef17-65dc-45ac-bb0f-d4a4bab3829d" (UID: "bbffef17-65dc-45ac-bb0f-d4a4bab3829d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:24:34.691110 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.691016    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:34.691110 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.691038    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:34.691110 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.691053    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:34.691110 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.691065    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:34.691414 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.691389    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-data" (OuterVolumeSpecName: "istio-data") pod "bbffef17-65dc-45ac-bb0f-d4a4bab3829d" (UID: "bbffef17-65dc-45ac-bb0f-d4a4bab3829d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:24:34.692885 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.692858    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-token" (OuterVolumeSpecName: "istio-token") pod "bbffef17-65dc-45ac-bb0f-d4a4bab3829d" (UID: "bbffef17-65dc-45ac-bb0f-d4a4bab3829d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:24:34.692996 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.692925    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-kube-api-access-4mthr" (OuterVolumeSpecName: "kube-api-access-4mthr") pod "bbffef17-65dc-45ac-bb0f-d4a4bab3829d" (UID: "bbffef17-65dc-45ac-bb0f-d4a4bab3829d"). InnerVolumeSpecName "kube-api-access-4mthr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:24:34.693157 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.693137    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bbffef17-65dc-45ac-bb0f-d4a4bab3829d" (UID: "bbffef17-65dc-45ac-bb0f-d4a4bab3829d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 18:24:34.693211 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.693142    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bbffef17-65dc-45ac-bb0f-d4a4bab3829d" (UID: "bbffef17-65dc-45ac-bb0f-d4a4bab3829d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:24:34.792065 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.792034    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:34.792065 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.792063    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mthr\" (UniqueName: \"kubernetes.io/projected/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-kube-api-access-4mthr\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:34.792065 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.792072    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:34.792307 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.792080    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:34.792307 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:34.792089    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbffef17-65dc-45ac-bb0f-d4a4bab3829d-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\""
Jul 27 18:24:35.012958 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.012864    2580 generic.go:356] "Generic (PLEG): container finished" podID="bbffef17-65dc-45ac-bb0f-d4a4bab3829d" containerID="21121363ace5098618fbf7e291a129682ff0beba215c30977111568a31cd300f" exitCode=0
Jul 27 18:24:35.012958 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.012922    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"
Jul 27 18:24:35.013159 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.012950    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh" event={"ID":"bbffef17-65dc-45ac-bb0f-d4a4bab3829d","Type":"ContainerDied","Data":"21121363ace5098618fbf7e291a129682ff0beba215c30977111568a31cd300f"}
Jul 27 18:24:35.013159 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.013014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh" event={"ID":"bbffef17-65dc-45ac-bb0f-d4a4bab3829d","Type":"ContainerDied","Data":"5d9ca320f7b5b5c4bac7cf770b343f58fb918fe184249dac0a983b773909e1e6"}
Jul 27 18:24:35.013159 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.013039    2580 scope.go:117] "RemoveContainer" containerID="21121363ace5098618fbf7e291a129682ff0beba215c30977111568a31cd300f"
Jul 27 18:24:35.022389 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.022372    2580 scope.go:117] "RemoveContainer" containerID="6af3db36c544f7fcbe9cf22da5052a860e56b8ca73d0360bbbfffa7623d0723d"
Jul 27 18:24:35.030158 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.030140    2580 scope.go:117] "RemoveContainer" containerID="21121363ace5098618fbf7e291a129682ff0beba215c30977111568a31cd300f"
Jul 27 18:24:35.030414 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:24:35.030397    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21121363ace5098618fbf7e291a129682ff0beba215c30977111568a31cd300f\": container with ID starting with 21121363ace5098618fbf7e291a129682ff0beba215c30977111568a31cd300f not found: ID does not exist" containerID="21121363ace5098618fbf7e291a129682ff0beba215c30977111568a31cd300f"
Jul 27 18:24:35.030455 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.030425    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21121363ace5098618fbf7e291a129682ff0beba215c30977111568a31cd300f"} err="failed to get container status \"21121363ace5098618fbf7e291a129682ff0beba215c30977111568a31cd300f\": rpc error: code = NotFound desc = could not find container \"21121363ace5098618fbf7e291a129682ff0beba215c30977111568a31cd300f\": container with ID starting with 21121363ace5098618fbf7e291a129682ff0beba215c30977111568a31cd300f not found: ID does not exist"
Jul 27 18:24:35.030455 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.030442    2580 scope.go:117] "RemoveContainer" containerID="6af3db36c544f7fcbe9cf22da5052a860e56b8ca73d0360bbbfffa7623d0723d"
Jul 27 18:24:35.030710 ip-10-0-131-200 kubenswrapper[2580]: E0727 18:24:35.030686    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6af3db36c544f7fcbe9cf22da5052a860e56b8ca73d0360bbbfffa7623d0723d\": container with ID starting with 6af3db36c544f7fcbe9cf22da5052a860e56b8ca73d0360bbbfffa7623d0723d not found: ID does not exist" containerID="6af3db36c544f7fcbe9cf22da5052a860e56b8ca73d0360bbbfffa7623d0723d"
Jul 27 18:24:35.030817 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.030715    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6af3db36c544f7fcbe9cf22da5052a860e56b8ca73d0360bbbfffa7623d0723d"} err="failed to get container status \"6af3db36c544f7fcbe9cf22da5052a860e56b8ca73d0360bbbfffa7623d0723d\": rpc error: code = NotFound desc = could not find container \"6af3db36c544f7fcbe9cf22da5052a860e56b8ca73d0360bbbfffa7623d0723d\": container with ID starting with 6af3db36c544f7fcbe9cf22da5052a860e56b8ca73d0360bbbfffa7623d0723d not found: ID does not exist"
Jul 27 18:24:35.035069 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.035046    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"]
Jul 27 18:24:35.038880 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.038857    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-1706dd-openshift-default-f9c57cb68-7lthh"]
Jul 27 18:24:35.373760 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.373675    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bb8dk_a638af53-8c4c-4760-9821-22d6e4c3e56f/manager/0.log"
Jul 27 18:24:35.476628 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.476569    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbffef17-65dc-45ac-bb0f-d4a4bab3829d" path="/var/lib/kubelet/pods/bbffef17-65dc-45ac-bb0f-d4a4bab3829d/volumes"
Jul 27 18:24:35.493946 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.493916    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2sf2p_6da74151-7b7b-4e5a-8912-837e512929bf/manager/0.log"
Jul 27 18:24:35.615348 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.615318    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d55c76586-n82wl_b23b1d81-b398-406b-982d-7ec8c40ebad6/manager/0.log"
Jul 27 18:24:35.724031 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.724006    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-x7wnf_c1d16e92-e371-4f4b-9b1b-586d0fb20540/server/0.log"
Jul 27 18:24:35.847491 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.847457    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6z8gb_bfc5ce3e-6266-4acd-8ea0-57150194ac01/manager/0.log"
Jul 27 18:24:35.957003 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.956972    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779d7f4b6d-2znm4_4c53353c-916f-48af-af94-cf49ab6c6bdd/copy-manifests/0.log"
Jul 27 18:24:35.964830 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:35.964805    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779d7f4b6d-2znm4_4c53353c-916f-48af-af94-cf49ab6c6bdd/manager/0.log"
Jul 27 18:24:36.560043 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:36.560013    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7665887c99-kdzhk_02809fa5-170d-493c-9735-e1d521f09737/maas-api/0.log"
Jul 27 18:24:36.669304 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:36.669273    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-jcpcb_da4d4ea8-fd78-4e24-ab5b-ad07aa57c8e4/postgres/0.log"
Jul 27 18:24:38.162878 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:38.162849    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xptg5_f1cf9b47-046a-4231-a3a0-cbaa930d87d5/manager/0.log"
Jul 27 18:24:38.275280 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:38.275250    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zv6st_68965fea-6a9f-418e-b0eb-0b5cb406e670/kuadrant-console-plugin/0.log"
Jul 27 18:24:38.395391 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:38.395355    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8sbv6_3f56d623-3f90-4b0a-8d06-56a27e980ce5/registry-server/0.log"
Jul 27 18:24:38.746304 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:38.746267    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-69ncf_455dcde8-ecea-4a34-91d6-212e2cff79d9/manager/0.log"
Jul 27 18:24:39.098533 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:39.098453    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn_b16284d6-9e6f-461e-8430-006b7c253bd1/istio-proxy/0.log"
Jul 27 18:24:39.440069 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:39.440043    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56bf8956b4-wvls5_73b549b6-eb05-4cc4-80b6-768f050e152e/kube-auth-proxy/0.log"
Jul 27 18:24:39.559864 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:39.559836    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-m99fz_dd61f14c-29e5-462e-b781-2068d16ab91b/istio-proxy/1.log"
Jul 27 18:24:39.679899 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:39.679868    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zh5mm_89ba1735-b440-4f06-9fba-5754462f04a7/payload-pre-processing/0.log"
Jul 27 18:24:39.806206 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:39.806097    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-r7tcz_0141a4a1-9e0c-4bc9-886c-96b86eca20a7/payload-processing/0.log"
Jul 27 18:24:40.254738 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:40.254711    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5n4jn_9535367d-9814-481b-a805-ff3c8e1990a4/main/0.log"
Jul 27 18:24:40.964212 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:40.964182    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-r5ck8_c7cd0507-005f-4c93-b2fa-2175ebf25c1b/main/0.log"
Jul 27 18:24:46.449294 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449253    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hshdv/must-gather-r6x7s"]
Jul 27 18:24:46.449709 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449674    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be0c480a-0558-4efe-a07d-662074073cd9" containerName="payload-processing"
Jul 27 18:24:46.449709 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449687    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="be0c480a-0558-4efe-a07d-662074073cd9" containerName="payload-processing"
Jul 27 18:24:46.449709 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449703    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c045999-2838-4ea2-ab35-69a2bf2a793e" containerName="istio-proxy"
Jul 27 18:24:46.449709 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449709    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c045999-2838-4ea2-ab35-69a2bf2a793e" containerName="istio-proxy"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449718    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0a49bf-bc54-4a7a-acd2-5911e294ac29" containerName="payload-pre-processing"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449725    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0a49bf-bc54-4a7a-acd2-5911e294ac29" containerName="payload-pre-processing"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449731    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbffef17-65dc-45ac-bb0f-d4a4bab3829d" containerName="istio-proxy"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449739    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbffef17-65dc-45ac-bb0f-d4a4bab3829d" containerName="istio-proxy"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449749    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63fce40f-b233-4412-9139-4e0eab0ce763" containerName="payload-processing"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449755    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63fce40f-b233-4412-9139-4e0eab0ce763" containerName="payload-processing"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449761    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e92f05fe-39e6-4f99-9a2e-513af65336a0" containerName="payload-processing"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449766    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e92f05fe-39e6-4f99-9a2e-513af65336a0" containerName="payload-processing"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449777    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c045999-2838-4ea2-ab35-69a2bf2a793e" containerName="istio-proxy"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449782    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c045999-2838-4ea2-ab35-69a2bf2a793e" containerName="istio-proxy"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449789    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d4c16df-e246-45da-8cbd-84ee0c04f24a" containerName="istio-proxy"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449794    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4c16df-e246-45da-8cbd-84ee0c04f24a" containerName="istio-proxy"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449803    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d4c16df-e246-45da-8cbd-84ee0c04f24a" containerName="istio-proxy"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449808    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4c16df-e246-45da-8cbd-84ee0c04f24a" containerName="istio-proxy"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449819    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="961f46af-2baf-4a36-a751-67077405d442" containerName="payload-pre-processing"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449827    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="961f46af-2baf-4a36-a751-67077405d442" containerName="payload-pre-processing"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449835    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2720560-8b48-45bf-a885-d0d507cd7764" containerName="payload-processing"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449840    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2720560-8b48-45bf-a885-d0d507cd7764" containerName="payload-processing"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449847    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbffef17-65dc-45ac-bb0f-d4a4bab3829d" containerName="istio-proxy"
Jul 27 18:24:46.449848 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449852    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbffef17-65dc-45ac-bb0f-d4a4bab3829d" containerName="istio-proxy"
Jul 27 18:24:46.450458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449858    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e5c2fc4-b88b-4a96-a608-38b3a46ced57" containerName="payload-processing"
Jul 27 18:24:46.450458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449863    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e5c2fc4-b88b-4a96-a608-38b3a46ced57" containerName="payload-processing"
Jul 27 18:24:46.450458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449930    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c045999-2838-4ea2-ab35-69a2bf2a793e" containerName="istio-proxy"
Jul 27 18:24:46.450458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449941    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="be0c480a-0558-4efe-a07d-662074073cd9" containerName="payload-processing"
Jul 27 18:24:46.450458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449946    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c045999-2838-4ea2-ab35-69a2bf2a793e" containerName="istio-proxy"
Jul 27 18:24:46.450458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449952    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d4c16df-e246-45da-8cbd-84ee0c04f24a" containerName="istio-proxy"
Jul 27 18:24:46.450458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449958    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbffef17-65dc-45ac-bb0f-d4a4bab3829d" containerName="istio-proxy"
Jul 27 18:24:46.450458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449963    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d4c16df-e246-45da-8cbd-84ee0c04f24a" containerName="istio-proxy"
Jul 27 18:24:46.450458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449970    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63fce40f-b233-4412-9139-4e0eab0ce763" containerName="payload-processing"
Jul 27 18:24:46.450458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449978    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2720560-8b48-45bf-a885-d0d507cd7764" containerName="payload-processing"
Jul 27 18:24:46.450458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449988    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e5c2fc4-b88b-4a96-a608-38b3a46ced57" containerName="payload-processing"
Jul 27 18:24:46.450458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449993    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b0a49bf-bc54-4a7a-acd2-5911e294ac29" containerName="payload-pre-processing"
Jul 27 18:24:46.450458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.449998    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="961f46af-2baf-4a36-a751-67077405d442" containerName="payload-pre-processing"
Jul 27 18:24:46.450458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.450003    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e92f05fe-39e6-4f99-9a2e-513af65336a0" containerName="payload-processing"
Jul 27 18:24:46.450458 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.450115    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbffef17-65dc-45ac-bb0f-d4a4bab3829d" containerName="istio-proxy"
Jul 27 18:24:46.454735 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.454715    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hshdv/must-gather-r6x7s"
Jul 27 18:24:46.457532 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.457509    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hshdv\"/\"openshift-service-ca.crt\""
Jul 27 18:24:46.458249 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.458227    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hshdv\"/\"kube-root-ca.crt\""
Jul 27 18:24:46.458372 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.458309    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hshdv\"/\"default-dockercfg-llb9b\""
Jul 27 18:24:46.461689 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.461661    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hshdv/must-gather-r6x7s"]
Jul 27 18:24:46.604939 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.604904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0b0b5015-06e7-496f-ba45-8249751107b6-must-gather-output\") pod \"must-gather-r6x7s\" (UID: \"0b0b5015-06e7-496f-ba45-8249751107b6\") " pod="openshift-must-gather-hshdv/must-gather-r6x7s"
Jul 27 18:24:46.605149 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.605035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8hzg\" (UniqueName: \"kubernetes.io/projected/0b0b5015-06e7-496f-ba45-8249751107b6-kube-api-access-l8hzg\") pod \"must-gather-r6x7s\" (UID: \"0b0b5015-06e7-496f-ba45-8249751107b6\") " pod="openshift-must-gather-hshdv/must-gather-r6x7s"
Jul 27 18:24:46.706081 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.705989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0b0b5015-06e7-496f-ba45-8249751107b6-must-gather-output\") pod \"must-gather-r6x7s\" (UID: \"0b0b5015-06e7-496f-ba45-8249751107b6\") " pod="openshift-must-gather-hshdv/must-gather-r6x7s"
Jul 27 18:24:46.706081 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.706067    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8hzg\" (UniqueName: \"kubernetes.io/projected/0b0b5015-06e7-496f-ba45-8249751107b6-kube-api-access-l8hzg\") pod \"must-gather-r6x7s\" (UID: \"0b0b5015-06e7-496f-ba45-8249751107b6\") " pod="openshift-must-gather-hshdv/must-gather-r6x7s"
Jul 27 18:24:46.706320 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.706301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0b0b5015-06e7-496f-ba45-8249751107b6-must-gather-output\") pod \"must-gather-r6x7s\" (UID: \"0b0b5015-06e7-496f-ba45-8249751107b6\") " pod="openshift-must-gather-hshdv/must-gather-r6x7s"
Jul 27 18:24:46.717506 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.717479    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8hzg\" (UniqueName: \"kubernetes.io/projected/0b0b5015-06e7-496f-ba45-8249751107b6-kube-api-access-l8hzg\") pod \"must-gather-r6x7s\" (UID: \"0b0b5015-06e7-496f-ba45-8249751107b6\") " pod="openshift-must-gather-hshdv/must-gather-r6x7s"
Jul 27 18:24:46.765479 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.765440    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hshdv/must-gather-r6x7s"
Jul 27 18:24:46.897399 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.897374    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hshdv/must-gather-r6x7s"]
Jul 27 18:24:46.899399 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:24:46.899367    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b0b5015_06e7_496f_ba45_8249751107b6.slice/crio-d8259c8a9e7f04e915673c9ea37c627f7a3fd36dc839758928a29da66130dce4 WatchSource:0}: Error finding container d8259c8a9e7f04e915673c9ea37c627f7a3fd36dc839758928a29da66130dce4: Status 404 returned error can't find the container with id d8259c8a9e7f04e915673c9ea37c627f7a3fd36dc839758928a29da66130dce4
Jul 27 18:24:46.901445 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:46.901425    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:24:47.071307 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:47.071215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hshdv/must-gather-r6x7s" event={"ID":"0b0b5015-06e7-496f-ba45-8249751107b6","Type":"ContainerStarted","Data":"d8259c8a9e7f04e915673c9ea37c627f7a3fd36dc839758928a29da66130dce4"}
Jul 27 18:24:48.079133 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:48.079034    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hshdv/must-gather-r6x7s" event={"ID":"0b0b5015-06e7-496f-ba45-8249751107b6","Type":"ContainerStarted","Data":"4a523c67059dccc41cdf945fbc536a6fad638f37ad065dc969ef3fd1d276b0d0"}
Jul 27 18:24:48.079133 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:48.079085    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hshdv/must-gather-r6x7s" event={"ID":"0b0b5015-06e7-496f-ba45-8249751107b6","Type":"ContainerStarted","Data":"b986f5f88504fcdbe2707a0ce968cf65c06e7ccb2e490d3040ca9cc92fd0682e"}
Jul 27 18:24:48.096802 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:48.096749    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hshdv/must-gather-r6x7s" podStartSLOduration=1.202704322 podStartE2EDuration="2.096731409s" totalImagesPullingTime="894.027087ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:24:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:24:48.094287395 +0000 UTC m=+3631.108953853" watchObservedRunningTime="2026-07-27 18:24:48.096731409 +0000 UTC m=+3631.111397892"
Jul 27 18:24:49.345001 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:49.344971    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g285v_f7ccecb8-cd50-4e6d-bf63-18ef88b8e8a4/global-pull-secret-syncer/0.log"
Jul 27 18:24:49.478890 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:49.478862    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bvhpw_c363bcd6-1a11-4e08-911a-74e0c07685c1/konnectivity-agent/0.log"
Jul 27 18:24:49.550406 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:49.550375    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-200.ec2.internal_0a61dacdec00e617530332f7c59343be/haproxy/0.log"
Jul 27 18:24:55.015808 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:55.015775    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xptg5_f1cf9b47-046a-4231-a3a0-cbaa930d87d5/manager/0.log"
Jul 27 18:24:55.069836 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:55.069796    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zv6st_68965fea-6a9f-418e-b0eb-0b5cb406e670/kuadrant-console-plugin/0.log"
Jul 27 18:24:55.118024 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:55.117986    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8sbv6_3f56d623-3f90-4b0a-8d06-56a27e980ce5/registry-server/0.log"
Jul 27 18:24:55.425531 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:55.425497    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-69ncf_455dcde8-ecea-4a34-91d6-212e2cff79d9/manager/0.log"
Jul 27 18:24:57.521825 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:57.521787    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nfm4k_1f9bda91-cbf2-440e-b218-97fa4a43709f/node-exporter/0.log"
Jul 27 18:24:57.541355 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:57.541327    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nfm4k_1f9bda91-cbf2-440e-b218-97fa4a43709f/kube-rbac-proxy/0.log"
Jul 27 18:24:57.561308 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:57.561277    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nfm4k_1f9bda91-cbf2-440e-b218-97fa4a43709f/init-textfile/0.log"
Jul 27 18:24:59.217019 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:59.216984    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-bqcbv_97944373-5fc9-4556-aac0-33c5aba5436c/networking-console-plugin/0.log"
Jul 27 18:24:59.906029 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:59.905994    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"]
Jul 27 18:24:59.912866 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:59.912836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:24:59.917555 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:59.917529    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"]
Jul 27 18:24:59.950918 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:59.950867    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/638ecd72-2e88-47a9-a20d-ed7f1f361370-proc\") pod \"perf-node-gather-daemonset-tkrkv\" (UID: \"638ecd72-2e88-47a9-a20d-ed7f1f361370\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:24:59.951286 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:59.951255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/638ecd72-2e88-47a9-a20d-ed7f1f361370-lib-modules\") pod \"perf-node-gather-daemonset-tkrkv\" (UID: \"638ecd72-2e88-47a9-a20d-ed7f1f361370\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:24:59.951508 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:59.951491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/638ecd72-2e88-47a9-a20d-ed7f1f361370-podres\") pod \"perf-node-gather-daemonset-tkrkv\" (UID: \"638ecd72-2e88-47a9-a20d-ed7f1f361370\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:24:59.951717 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:59.951702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/638ecd72-2e88-47a9-a20d-ed7f1f361370-sys\") pod \"perf-node-gather-daemonset-tkrkv\" (UID: \"638ecd72-2e88-47a9-a20d-ed7f1f361370\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:24:59.951971 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:24:59.951948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x65ld\" (UniqueName: \"kubernetes.io/projected/638ecd72-2e88-47a9-a20d-ed7f1f361370-kube-api-access-x65ld\") pod \"perf-node-gather-daemonset-tkrkv\" (UID: \"638ecd72-2e88-47a9-a20d-ed7f1f361370\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:25:00.053163 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:00.053130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x65ld\" (UniqueName: \"kubernetes.io/projected/638ecd72-2e88-47a9-a20d-ed7f1f361370-kube-api-access-x65ld\") pod \"perf-node-gather-daemonset-tkrkv\" (UID: \"638ecd72-2e88-47a9-a20d-ed7f1f361370\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:25:00.053356 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:00.053172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/638ecd72-2e88-47a9-a20d-ed7f1f361370-proc\") pod \"perf-node-gather-daemonset-tkrkv\" (UID: \"638ecd72-2e88-47a9-a20d-ed7f1f361370\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:25:00.053356 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:00.053199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/638ecd72-2e88-47a9-a20d-ed7f1f361370-lib-modules\") pod \"perf-node-gather-daemonset-tkrkv\" (UID: \"638ecd72-2e88-47a9-a20d-ed7f1f361370\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:25:00.053356 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:00.053231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/638ecd72-2e88-47a9-a20d-ed7f1f361370-podres\") pod \"perf-node-gather-daemonset-tkrkv\" (UID: \"638ecd72-2e88-47a9-a20d-ed7f1f361370\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:25:00.053356 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:00.053254    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/638ecd72-2e88-47a9-a20d-ed7f1f361370-sys\") pod \"perf-node-gather-daemonset-tkrkv\" (UID: \"638ecd72-2e88-47a9-a20d-ed7f1f361370\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:25:00.053356 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:00.053283    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/638ecd72-2e88-47a9-a20d-ed7f1f361370-proc\") pod \"perf-node-gather-daemonset-tkrkv\" (UID: \"638ecd72-2e88-47a9-a20d-ed7f1f361370\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:25:00.053356 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:00.053339    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/638ecd72-2e88-47a9-a20d-ed7f1f361370-sys\") pod \"perf-node-gather-daemonset-tkrkv\" (UID: \"638ecd72-2e88-47a9-a20d-ed7f1f361370\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:25:00.053639 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:00.053412    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/638ecd72-2e88-47a9-a20d-ed7f1f361370-podres\") pod \"perf-node-gather-daemonset-tkrkv\" (UID: \"638ecd72-2e88-47a9-a20d-ed7f1f361370\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:25:00.053639 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:00.053437    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/638ecd72-2e88-47a9-a20d-ed7f1f361370-lib-modules\") pod \"perf-node-gather-daemonset-tkrkv\" (UID: \"638ecd72-2e88-47a9-a20d-ed7f1f361370\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:25:00.061069 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:00.061036    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x65ld\" (UniqueName: \"kubernetes.io/projected/638ecd72-2e88-47a9-a20d-ed7f1f361370-kube-api-access-x65ld\") pod \"perf-node-gather-daemonset-tkrkv\" (UID: \"638ecd72-2e88-47a9-a20d-ed7f1f361370\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:25:00.227631 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:00.227517    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:25:00.403811 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:00.403683    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"]
Jul 27 18:25:00.407122 ip-10-0-131-200 kubenswrapper[2580]: W0727 18:25:00.407053    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod638ecd72_2e88_47a9_a20d_ed7f1f361370.slice/crio-e8446d548c174ee206c4c1715a13d2b5c1ad2a925b78a2110dc13dce02db29ba WatchSource:0}: Error finding container e8446d548c174ee206c4c1715a13d2b5c1ad2a925b78a2110dc13dce02db29ba: Status 404 returned error can't find the container with id e8446d548c174ee206c4c1715a13d2b5c1ad2a925b78a2110dc13dce02db29ba
Jul 27 18:25:01.177309 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:01.177270    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv" event={"ID":"638ecd72-2e88-47a9-a20d-ed7f1f361370","Type":"ContainerStarted","Data":"4b0998686b3bc4102db50bb631c02210f350c5aa6752011553f04b2875cf5d42"}
Jul 27 18:25:01.177492 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:01.177337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv" event={"ID":"638ecd72-2e88-47a9-a20d-ed7f1f361370","Type":"ContainerStarted","Data":"e8446d548c174ee206c4c1715a13d2b5c1ad2a925b78a2110dc13dce02db29ba"}
Jul 27 18:25:01.177492 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:01.177380    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:25:01.192268 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:01.192206    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv" podStartSLOduration=2.192186089 podStartE2EDuration="2.192186089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:24:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:25:01.191469708 +0000 UTC m=+3644.206136153" watchObservedRunningTime="2026-07-27 18:25:01.192186089 +0000 UTC m=+3644.206852535"
Jul 27 18:25:02.012242 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:02.012204    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7f45_77db0526-9ce6-4899-9e8c-07448e529a34/dns/0.log"
Jul 27 18:25:02.030888 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:02.030842    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7f45_77db0526-9ce6-4899-9e8c-07448e529a34/kube-rbac-proxy/0.log"
Jul 27 18:25:02.103980 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:02.103953    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-trb87_5ac14a62-8827-4d06-a67d-2ac290fb0ae7/dns-node-resolver/0.log"
Jul 27 18:25:02.708521 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:02.708483    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rwn2d_ce020319-484a-4868-86f5-4bb9683bac2f/node-ca/0.log"
Jul 27 18:25:03.630478 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:03.630441    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn_b16284d6-9e6f-461e-8430-006b7c253bd1/istio-proxy/0.log"
Jul 27 18:25:03.825350 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:03.825307    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56bf8956b4-wvls5_73b549b6-eb05-4cc4-80b6-768f050e152e/kube-auth-proxy/0.log"
Jul 27 18:25:03.858647 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:03.858616    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-m99fz_dd61f14c-29e5-462e-b781-2068d16ab91b/istio-proxy/0.log"
Jul 27 18:25:03.917825 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:03.917792    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-m99fz_dd61f14c-29e5-462e-b781-2068d16ab91b/istio-proxy/1.log"
Jul 27 18:25:03.961386 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:03.961351    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zh5mm_89ba1735-b440-4f06-9fba-5754462f04a7/payload-pre-processing/0.log"
Jul 27 18:25:03.998705 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:03.998666    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-r7tcz_0141a4a1-9e0c-4bc9-886c-96b86eca20a7/payload-processing/0.log"
Jul 27 18:25:04.812154 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:04.812101    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-677g9_e66a5198-bfde-4dc9-9bab-0b58f4e80b37/serve-healthcheck-canary/0.log"
Jul 27 18:25:05.453127 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:05.453093    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vghm6_f7333a6f-a9f9-48a7-998a-cc9438b6031b/kube-rbac-proxy/0.log"
Jul 27 18:25:05.479959 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:05.479931    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vghm6_f7333a6f-a9f9-48a7-998a-cc9438b6031b/exporter/0.log"
Jul 27 18:25:05.503102 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:05.503071    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vghm6_f7333a6f-a9f9-48a7-998a-cc9438b6031b/extractor/0.log"
Jul 27 18:25:07.197757 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:07.197714    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-tkrkv"
Jul 27 18:25:07.570042 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:07.569958    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bb8dk_a638af53-8c4c-4760-9821-22d6e4c3e56f/manager/0.log"
Jul 27 18:25:07.987885 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:07.987848    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2sf2p_6da74151-7b7b-4e5a-8912-837e512929bf/manager/0.log"
Jul 27 18:25:08.247620 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:08.247057    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d55c76586-n82wl_b23b1d81-b398-406b-982d-7ec8c40ebad6/manager/0.log"
Jul 27 18:25:08.267961 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:08.267933    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-x7wnf_c1d16e92-e371-4f4b-9b1b-586d0fb20540/server/0.log"
Jul 27 18:25:08.398843 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:08.398817    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6z8gb_bfc5ce3e-6266-4acd-8ea0-57150194ac01/manager/0.log"
Jul 27 18:25:08.427810 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:08.427773    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779d7f4b6d-2znm4_4c53353c-916f-48af-af94-cf49ab6c6bdd/manager/0.log"
Jul 27 18:25:08.452109 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:08.451885    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779d7f4b6d-2znm4_4c53353c-916f-48af-af94-cf49ab6c6bdd/copy-manifests/0.log"
Jul 27 18:25:09.964024 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:09.963991    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn_b16284d6-9e6f-461e-8430-006b7c253bd1/istio-proxy/0.log"
Jul 27 18:25:10.038788 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:10.038753    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-62wjc_61c34123-c9ee-42c4-a24a-56273753af3c/openshift-lws-operator/0.log"
Jul 27 18:25:10.148742 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:10.148712    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56bf8956b4-wvls5_73b549b6-eb05-4cc4-80b6-768f050e152e/kube-auth-proxy/0.log"
Jul 27 18:25:10.182327 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:10.182297    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-m99fz_dd61f14c-29e5-462e-b781-2068d16ab91b/istio-proxy/0.log"
Jul 27 18:25:10.239088 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:10.239054    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-m99fz_dd61f14c-29e5-462e-b781-2068d16ab91b/istio-proxy/1.log"
Jul 27 18:25:10.267612 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:10.267556    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zh5mm_89ba1735-b440-4f06-9fba-5754462f04a7/payload-pre-processing/0.log"
Jul 27 18:25:10.301605 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:10.300771    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-r7tcz_0141a4a1-9e0c-4bc9-886c-96b86eca20a7/payload-processing/0.log"
Jul 27 18:25:11.638353 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:11.638322    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xkpsn_b16284d6-9e6f-461e-8430-006b7c253bd1/istio-proxy/0.log"
Jul 27 18:25:11.824561 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:11.824530    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56bf8956b4-wvls5_73b549b6-eb05-4cc4-80b6-768f050e152e/kube-auth-proxy/0.log"
Jul 27 18:25:11.859083 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:11.859055    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-m99fz_dd61f14c-29e5-462e-b781-2068d16ab91b/istio-proxy/0.log"
Jul 27 18:25:11.912913 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:11.911174    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-m99fz_dd61f14c-29e5-462e-b781-2068d16ab91b/istio-proxy/1.log"
Jul 27 18:25:11.943102 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:11.943073    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zh5mm_89ba1735-b440-4f06-9fba-5754462f04a7/payload-pre-processing/0.log"
Jul 27 18:25:11.981431 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:11.981395    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-r7tcz_0141a4a1-9e0c-4bc9-886c-96b86eca20a7/payload-processing/0.log"
Jul 27 18:25:16.343659 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:16.343630    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lr6rh_b18fd914-4db8-475c-ac98-4d024ab840b3/kube-multus-additional-cni-plugins/0.log"
Jul 27 18:25:16.373244 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:16.373220    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lr6rh_b18fd914-4db8-475c-ac98-4d024ab840b3/egress-router-binary-copy/0.log"
Jul 27 18:25:16.397306 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:16.397276    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lr6rh_b18fd914-4db8-475c-ac98-4d024ab840b3/cni-plugins/0.log"
Jul 27 18:25:16.420461 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:16.420434    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lr6rh_b18fd914-4db8-475c-ac98-4d024ab840b3/bond-cni-plugin/0.log"
Jul 27 18:25:16.443502 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:16.443467    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lr6rh_b18fd914-4db8-475c-ac98-4d024ab840b3/routeoverride-cni/0.log"
Jul 27 18:25:16.467855 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:16.467820    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lr6rh_b18fd914-4db8-475c-ac98-4d024ab840b3/whereabouts-cni-bincopy/0.log"
Jul 27 18:25:16.490981 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:16.490959    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lr6rh_b18fd914-4db8-475c-ac98-4d024ab840b3/whereabouts-cni/0.log"
Jul 27 18:25:16.754478 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:16.754445    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z2lls_06143fc2-1884-4652-b9ba-20b433e4febc/kube-multus/0.log"
Jul 27 18:25:16.825895 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:16.825856    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h66wv_5531f102-84da-411c-99df-840e1f4b871a/network-metrics-daemon/0.log"
Jul 27 18:25:16.840440 ip-10-0-131-200 kubenswrapper[2580]: I0727 18:25:16.840417    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h66wv_5531f102-84da-411c-99df-840e1f4b871a/kube-rbac-proxy/0.log"