Jul 28 20:24:45.625276 ip-10-0-137-26 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 20:24:46.075992 ip-10-0-137-26 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 20:24:46.075992 ip-10-0-137-26 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 20:24:46.075992 ip-10-0-137-26 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 20:24:46.075992 ip-10-0-137-26 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 20:24:46.075992 ip-10-0-137-26 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 20:24:46.078918 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.078830    2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 20:24:46.086730 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086699    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:24:46.086730 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086724    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:24:46.086730 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086728    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:24:46.086730 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086731    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:24:46.086730 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086734    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:24:46.086730 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086737    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:24:46.086730 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086740    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:24:46.086730 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086743    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:24:46.086730 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086746    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086749    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086752    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086755    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086758    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086762    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086764    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086767    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086770    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086772    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086775    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086779    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086781    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086784    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086787    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086789    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086792    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086796    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086801    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086804    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:24:46.087074 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086807    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086810    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086812    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086815    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086818    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086822    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086826    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086828    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086831    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086834    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086836    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086839    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086842    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086844    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086849    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086852    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086855    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086857    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086860    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086863    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:24:46.087549 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086866    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086869    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086872    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086874    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086877    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086880    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086882    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086885    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086887    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086890    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086892    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086895    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086897    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086900    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086904    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086909    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086912    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086915    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086917    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:24:46.088076 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086920    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086922    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086925    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086941    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086944    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086947    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086950    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086954    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086957    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086959    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086962    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086965    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086967    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086970    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086973    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086975    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086978    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086981    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086984    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086986    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:24:46.088572 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086989    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086993    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086996    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.086998    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.087001    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.087003    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.087006    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.087009    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.087011    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.087014    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.087016    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.087019    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088824    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088832    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088835    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088838    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088841    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088844    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088847    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088850    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:24:46.089086 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088854    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088857    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088860    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088863    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088866    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088868    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088871    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088874    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088876    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088880    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088882    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088885    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088887    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088890    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088893    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088896    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088899    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088901    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088904    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088908    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:24:46.089569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088910    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088913    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088915    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088918    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088921    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088924    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088926    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088951    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088954    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088957    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088960    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088962    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088965    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088967    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088970    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088973    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088977    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088979    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088982    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:24:46.090083 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088986    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088990    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088994    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.088998    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089002    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089005    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089008    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089011    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089013    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089017    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089020    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089023    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089026    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089029    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089031    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089034    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089037    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089039    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089043    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:24:46.090551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089046    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089049    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089052    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089054    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089057    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089059    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089062    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089065    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089067    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089070    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089073    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089076    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089080    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089083    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089086    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089089    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089092    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089097    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089100    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089103    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:24:46.091053 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089106    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089108    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089111    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089114    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089117    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089119    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089122    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089124    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089127    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089129    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089132    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089134    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089137    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089547    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089552    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089555    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089558    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089561    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089565    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:24:46.091547 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089569    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089572    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089578    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089582    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089585    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089588    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089591    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089594    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089596    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089599    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089604    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089607    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089610    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089612    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089615    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089618    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089621    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089624    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089628    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089631    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:24:46.092038 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089634    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089636    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089639    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089642    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089644    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089646    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089649    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089652    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089654    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089657    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089660    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089662    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089665    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089667    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089670    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089673    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089676    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089678    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089681    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089683    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:24:46.092525 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089686    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089688    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089691    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089695    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089697    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089700    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089702    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089705    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089707    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089710    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089712    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089716    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089718    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089721    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089723    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089726    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089728    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089731    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089733    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:24:46.093032 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089736    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089739    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089741    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089744    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089746    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089749    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089751    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089754    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089758    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089760    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089763    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089765    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089768    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089771    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089773    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089776    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089779    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089785    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089788    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:24:46.093531 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089791    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089795    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089797    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089800    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089803    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089806    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089809    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089811    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089814    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089817    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089820    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089822    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089825    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089828    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.089831    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089911    2555 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089919    2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089926    2555 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089944    2555 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089948    2555 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089952    2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 20:24:46.094033 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089957    2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089962    2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089965    2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089968    2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089972    2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089975    2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089978    2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089984    2555 flags.go:64] FLAG: --cgroup-root=""
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089987    2555 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089990    2555 flags.go:64] FLAG: --client-ca-file=""
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089994    2555 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.089998    2555 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090003    2555 flags.go:64] FLAG: --cluster-domain=""
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090006    2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090009    2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090012    2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090015    2555 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090019    2555 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090022    2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090026    2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090029    2555 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090032    2555 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090035    2555 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090038    2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 20:24:46.094562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090041    2555 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090044    2555 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090055    2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090058    2555 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090061    2555 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090064    2555 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090068    2555 flags.go:64] FLAG: --enable-server="true"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090071    2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090078    2555 flags.go:64] FLAG: --event-burst="100"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090081    2555 flags.go:64] FLAG: --event-qps="50"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090084    2555 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090088    2555 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090091    2555 flags.go:64] FLAG: --eviction-hard=""
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090095    2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090098    2555 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090103    2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090106    2555 flags.go:64] FLAG: --eviction-soft=""
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090109    2555 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090112    2555 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090121    2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090124    2555 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090127    2555 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090130    2555 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090133    2555 flags.go:64] FLAG: --feature-gates=""
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090136    2555 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 20:24:46.095173 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090139    2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090143    2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090146    2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090149    2555 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090152    2555 flags.go:64] FLAG: --help="false"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090155    2555 flags.go:64] FLAG: --hostname-override="ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090159    2555 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090162    2555 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090165    2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090168    2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090171    2555 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090174    2555 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090177    2555 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090179    2555 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090185    2555 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090188    2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090191    2555 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090194    2555 flags.go:64] FLAG: --kube-reserved=""
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090197    2555 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090200    2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090203    2555 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090206    2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090211    2555 flags.go:64] FLAG: --lock-file=""
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090213    2555 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 20:24:46.095907 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090216    2555 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090220    2555 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090226    2555 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090230    2555 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090233    2555 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090236    2555 flags.go:64] FLAG: --logging-format="text"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090239    2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090242    2555 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090245    2555 flags.go:64] FLAG: --manifest-url=""
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090248    2555 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090253    2555 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090256    2555 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090260    2555 flags.go:64] FLAG: --max-pods="110"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090264    2555 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090267    2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090270    2555 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090273    2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090276    2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090279    2555 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090282    2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090289    2555 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090293    2555 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090297    2555 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 20:24:46.096537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090300    2555 flags.go:64] FLAG: --pod-cidr=""
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090304    2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090309    2555 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090312    2555 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090315    2555 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090318    2555 flags.go:64] FLAG: --port="10250"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090321    2555 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090326    2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05866d08fd608d249"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090329    2555 flags.go:64] FLAG: --qos-reserved=""
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090332    2555 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090335    2555 flags.go:64] FLAG: --register-node="true"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090338    2555 flags.go:64] FLAG: --register-with-taints=""
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090342    2555 flags.go:64] FLAG: --registry-burst="10"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090345    2555 flags.go:64] FLAG: --registry-qps="5"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090348    2555 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090352    2555 flags.go:64] FLAG: --reserved-memory=""
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090355    2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090358    2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090361    2555 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090364    2555 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090367    2555 flags.go:64] FLAG: --runonce="false"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090370    2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090374    2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090377    2555 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090380    2555 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 20:24:46.097147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090383    2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090386    2555 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090389    2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090392    2555 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090395    2555 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090398    2555 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090401    2555 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090405    2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090408    2555 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090411    2555 flags.go:64] FLAG: --system-cgroups=""
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090414    2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090420    2555 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090423    2555 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090425    2555 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090434    2555 flags.go:64] FLAG: --tls-min-version=""
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090437    2555 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090440    2555 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090443    2555 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090446    2555 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090450    2555 flags.go:64] FLAG: --v="2"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090454    2555 flags.go:64] FLAG: --version="false"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090459    2555 flags.go:64] FLAG: --vmodule=""
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090462    2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.090466    2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090598    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:24:46.097775 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090603    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090606    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090609    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090613    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090616    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090619    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090622    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090625    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090629    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090632    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090635    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090639    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090641    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090644    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090648    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090651    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090654    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090656    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090659    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090662    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:24:46.098463 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090665    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090668    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090671    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090673    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090676    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090678    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090681    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090684    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090687    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090690    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090692    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090695    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090698    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090700    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090703    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090705    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090708    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090711    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090714    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:24:46.098993 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090716    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090719    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090721    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090724    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090726    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090729    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090731    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090735    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090738    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090740    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090744    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090748    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090751    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090754    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090756    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090759    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090761    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090764    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090767    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090769    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:24:46.099454 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090772    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090774    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090777    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090780    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090783    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090786    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090788    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090791    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090793    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090796    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090799    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090801    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090804    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090806    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090809    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090812    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090814    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090816    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090819    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090823    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:24:46.099969 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090826    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090829    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090831    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090834    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090837    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090839    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090842    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090844    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090847    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090850    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090852    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090855    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090858    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090860    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090862    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090865    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090874    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090877    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:24:46.100467 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.090881    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:24:46.100908 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.091605    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 20:24:46.100908 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.098901    2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 20:24:46.100908 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.098920    2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 20:24:46.100908 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.098956    2555 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 20:24:46.100908 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.098963    2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 20:24:46.100908 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099025    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:24:46.100908 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099030    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:24:46.100908 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099034    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:24:46.100908 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099037    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:24:46.100908 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099041    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:24:46.100908 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099044    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:24:46.100908 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099047    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:24:46.100908 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099050    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:24:46.100908 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099053    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:24:46.100908 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099056    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099059    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099062    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099064    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099067    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099070    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099072    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099075    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099078    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099080    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099083    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099086    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099089    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099093    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099095    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099099    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099102    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099104    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099107    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:24:46.101304 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099111    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099116    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099120    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099123    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099125    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099128    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099131    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099133    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099136    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099138    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099141    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099146    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099150    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099153    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099156    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099159    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099162    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099165    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099168    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:24:46.101772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099171    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099174    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099177    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099179    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099182    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099185    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099187    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099190    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099193    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099196    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099199    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099202    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099204    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099207    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099210    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099213    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099215    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099218    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099221    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099223    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:24:46.102243 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099226    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099228    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099231    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099234    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099236    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099239    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099241    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099244    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099247    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099249    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099253    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099256    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099259    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099261    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099264    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099266    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099269    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099271    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099275    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099278    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:24:46.102777 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099281    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:24:46.103299 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099283    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:24:46.103299 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099285    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:24:46.103299 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099288    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:24:46.103299 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099291    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:24:46.103299 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099293    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:24:46.103299 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099296    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:24:46.103299 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099299    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:24:46.103299 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099302    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:24:46.103299 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099305    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:24:46.103299 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099307    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:24:46.103299 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099310    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:24:46.103299 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.099315    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 20:24:46.103299 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099433    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:24:46.103299 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099437    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:24:46.103299 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099440    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099442    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099445    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099448    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099451    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099453    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099456    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099459    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099461    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099464    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099467    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099470    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099472    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099475    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099478    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099481    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099484    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099487    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099489    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099492    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:24:46.103665 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099494    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099497    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099500    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099503    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099505    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099508    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099511    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099513    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099516    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099518    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099521    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099524    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099526    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099529    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099531    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099534    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099537    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099539    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099542    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099545    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:24:46.104162 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099548    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099550    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099553    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099555    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099558    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099560    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099563    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099566    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099570    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099573    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099577    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099581    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099584    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099586    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099590    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099592    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099595    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099597    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099600    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:24:46.104644 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099603    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099605    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099608    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099611    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099613    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099616    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099618    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099621    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099623    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099626    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099628    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099631    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099633    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099637    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099640    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099643    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099646    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099648    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099651    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:24:46.105124 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099654    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099657    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099659    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099662    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099665    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099667    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099669    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099673    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099676    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099679    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099682    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099684    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099687    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099689    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099692    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099694    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099697    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099699    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:24:46.105586 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:46.099702    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:24:46.106178 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.099707    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 20:24:46.106178 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.099831    2555 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 20:24:46.106178 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.102356    2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 20:24:46.106178 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.104061    2555 server.go:1019] "Starting client certificate rotation"
Jul 28 20:24:46.106178 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.104159    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 20:24:46.106178 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.104198    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 20:24:46.106922 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.106907    2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 20:24:46.108110 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.108092    2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 20:24:46.120012 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.119992    2555 log.go:25] "Validated CRI v1 runtime API"
Jul 28 20:24:46.122637 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.122614    2555 log.go:25] "Validated CRI v1 image API"
Jul 28 20:24:46.125695 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.125677    2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 20:24:46.132056 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.132031    2555 fs.go:135] Filesystem UUIDs: map[3ea846d3-b5cb-4aa0-81b5-1bf8086f6f3f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a339a42e-06c2-4235-9b69-947d09ec7add:/dev/nvme0n1p3]
Jul 28 20:24:46.132144 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.132055    2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 20:24:46.138374 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.138244    2555 manager.go:216] Machine: {Timestamp:2026-07-28 20:24:46.135818119 +0000 UTC m=+0.381194813 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100944 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec228e17416335704c166e285034a2c1 SystemUUID:ec228e17-4163-3570-4c16-6e285034a2c1 BootID:0c84933f-b3c6-4bb9-a595-8b4ff6305305 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c7:ef:f0:80:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c7:ef:f0:80:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:de:4a:8f:51:d1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 20:24:46.138374 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.138361    2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 20:24:46.138553 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.138476    2555 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 20:24:46.140865 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.140837    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 20:24:46.141435 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.141403    2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 20:24:46.141633 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.141444    2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-26.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 20:24:46.142374 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.142361    2555 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 20:24:46.142441 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.142380    2555 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 20:24:46.142441 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.142393    2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 20:24:46.142441 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.142415    2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 20:24:46.144369 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.144355    2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 20:24:46.149026 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.149013    2555 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 20:24:46.149167 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.149156    2555 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 20:24:46.149215 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.149204    2555 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 20:24:46.149252 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.149214    2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 20:24:46.149252 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.149230    2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 20:24:46.149252 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.149239    2555 kubelet.go:398] "Adding apiserver pod source"
Jul 28 20:24:46.149252 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.149247    2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 20:24:46.149614 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.149603    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 20:24:46.149655 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.149621    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 20:24:46.152620 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.152605    2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 20:24:46.154464 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.154450    2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 20:24:46.154516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.154483    2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 20:24:46.155234 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.155222    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 20:24:46.155234 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.155237    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 20:24:46.155352 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.155243    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 20:24:46.155352 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.155249    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 20:24:46.155352 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.155257    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 20:24:46.155352 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.155262    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 20:24:46.155352 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.155296    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 20:24:46.155352 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.155303    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 20:24:46.155352 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.155310    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 20:24:46.155352 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.155316    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 20:24:46.155352 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.155325    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 20:24:46.155352 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.155333    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 20:24:46.156825 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.156812    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 20:24:46.156869 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.156828    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 20:24:46.160275 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.160260    2555 server.go:1268] "Started kubelet"
Jul 28 20:24:46.160362 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.160319    2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 20:24:46.160894 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.160473    2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 20:24:46.160894 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.160563    2555 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 20:24:46.161222 ip-10-0-137-26 systemd[1]: Started Kubernetes Kubelet.
Jul 28 20:24:46.161407 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.161280    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 20:24:46.161407 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.161323    2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-26.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 20:24:46.161537 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.161510    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 20:24:46.165783 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.165758    2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 20:24:46.167363 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.167342    2555 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 20:24:46.167879 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.167828    2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 20:24:46.171264 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.170126    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-26.ec2.internal.18c68dddd2a3f97c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-26.ec2.internal,UID:ip-10-0-137-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-26.ec2.internal,},FirstTimestamp:2026-07-28 20:24:46.16023078 +0000 UTC m=+0.405607474,LastTimestamp:2026-07-28 20:24:46.16023078 +0000 UTC m=+0.405607474,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-26.ec2.internal,}"
Jul 28 20:24:46.174683 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.174660    2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 20:24:46.174683 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.174672    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 20:24:46.174823 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.174771    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found"
Jul 28 20:24:46.175825 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.175517    2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 20:24:46.175960 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.175921    2555 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 20:24:46.176056 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.175965    2555 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 20:24:46.176103 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.176082    2555 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 20:24:46.176103 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.176088    2555 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 20:24:46.179401 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.179384    2555 factory.go:55] Registering systemd factory
Jul 28 20:24:46.179486 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.179404    2555 factory.go:223] Registration of the systemd container factory successfully
Jul 28 20:24:46.179670 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.179658    2555 factory.go:153] Registering CRI-O factory
Jul 28 20:24:46.179714 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.179673    2555 factory.go:223] Registration of the crio container factory successfully
Jul 28 20:24:46.179763 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.179715    2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 20:24:46.179763 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.179737    2555 factory.go:103] Registering Raw factory
Jul 28 20:24:46.179763 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.179749    2555 manager.go:1196] Started watching for new ooms in manager
Jul 28 20:24:46.180819 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.180804    2555 manager.go:349] Starting recovery of all containers
Jul 28 20:24:46.187200 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.187171    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 20:24:46.187200 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.187192    2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 20:24:46.191299 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.191284    2555 manager.go:354] Recovery completed
Jul 28 20:24:46.195642 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.195625    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:24:46.197614 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.197592    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:24:46.197703 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.197632    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:24:46.197703 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.197644    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:24:46.198241 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.198227    2555 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 20:24:46.198241 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.198240    2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 20:24:46.198359 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.198256    2555 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 20:24:46.198359 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.198227    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:24:46.199114 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.199097    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:24:46.199196 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.199129    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:24:46.199196 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.199142    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:24:46.200431 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.200419    2555 policy_none.go:49] "None policy: Start"
Jul 28 20:24:46.200495 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.200442    2555 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 20:24:46.200495 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.200453    2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 20:24:46.202439 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.202424    2555 policy_none.go:47] "Start"
Jul 28 20:24:46.206649 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.206629    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ztjrl"
Jul 28 20:24:46.208559 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.208487    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-26.ec2.internal.18c68dddd4de5ee2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-26.ec2.internal,UID:ip-10-0-137-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-26.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-26.ec2.internal,},FirstTimestamp:2026-07-28 20:24:46.197612258 +0000 UTC m=+0.442988955,LastTimestamp:2026-07-28 20:24:46.197612258 +0000 UTC m=+0.442988955,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-26.ec2.internal,}"
Jul 28 20:24:46.212727 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.212656    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-26.ec2.internal.18c68dddd4dec2cb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-26.ec2.internal,UID:ip-10-0-137-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-26.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-26.ec2.internal,},FirstTimestamp:2026-07-28 20:24:46.197637835 +0000 UTC m=+0.443014527,LastTimestamp:2026-07-28 20:24:46.197637835 +0000 UTC m=+0.443014527,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-26.ec2.internal,}"
Jul 28 20:24:46.218030 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.217994    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ztjrl"
Jul 28 20:24:46.218772 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.218677    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-26.ec2.internal.18c68dddd4deecdf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-26.ec2.internal,UID:ip-10-0-137-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-26.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-26.ec2.internal,},FirstTimestamp:2026-07-28 20:24:46.197648607 +0000 UTC m=+0.443025300,LastTimestamp:2026-07-28 20:24:46.197648607 +0000 UTC m=+0.443025300,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-26.ec2.internal,}"
Jul 28 20:24:46.225909 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.225836    2555 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-26.ec2.internal.18c68dddd4de5ee2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-26.ec2.internal.18c68dddd4de5ee2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-26.ec2.internal,UID:ip-10-0-137-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-26.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-26.ec2.internal,},FirstTimestamp:2026-07-28 20:24:46.197612258 +0000 UTC m=+0.442988955,LastTimestamp:2026-07-28 20:24:46.199113365 +0000 UTC m=+0.444490062,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-26.ec2.internal,}"
Jul 28 20:24:46.274901 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.274874    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found"
Jul 28 20:24:46.287660 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.287625    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 20:24:46.288834 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.288815    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 20:24:46.288956 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.288852    2555 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 20:24:46.288956 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.288873    2555 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 20:24:46.288956 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.288906    2555 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 28 20:24:46.291885 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.291863    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:24:46.292621 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.292604    2555 manager.go:337] "Starting Device Plugin manager"
Jul 28 20:24:46.292705 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.292638    2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 20:24:46.292705 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.292649    2555 server.go:87] "Starting device plugin registration server"
Jul 28 20:24:46.292947 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.292921    2555 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 20:24:46.293002 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.292949    2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 20:24:46.293116 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.293103    2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 20:24:46.293206 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.293189    2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 20:24:46.293206 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.293202    2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 20:24:46.293671 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.293654    2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 20:24:46.293745 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.293707    2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-26.ec2.internal\" not found"
Jul 28 20:24:46.389860 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.389768    2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal"]
Jul 28 20:24:46.389860 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.389852    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:24:46.390849 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.390832    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:24:46.390974 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.390866    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:24:46.390974 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.390879    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:24:46.393300 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.393283    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:24:46.393300 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.393295    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:24:46.393423 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.393388    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.393423 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.393409    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:24:46.394000 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.393982    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:24:46.394090 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.394007    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:24:46.394090 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.394018    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:24:46.394090 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.394040    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:24:46.394090 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.394062    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:24:46.394090 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.394075    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:24:46.394275 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.394095    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:24:46.394275 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.394113    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:24:46.394275 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.394122    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:24:46.394275 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.394145    2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.394626 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.394607    2555 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-26.ec2.internal\" not found" node="ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.396397 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.396383    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.396455 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.396408    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:24:46.397052 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.397037    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:24:46.397117 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.397062    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:24:46.397117 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.397071    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:24:46.404069 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.404054    2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.404141 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.404074    2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-26.ec2.internal\": node \"ip-10-0-137-26.ec2.internal\" not found"
Jul 28 20:24:46.413563 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.413545    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-26.ec2.internal\" not found" node="ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.417142 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.417122    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-26.ec2.internal\" not found" node="ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.441447 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.441417    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found"
Jul 28 20:24:46.478415 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.478383    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/130d71e16700185813be32f181bd7fb9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-26.ec2.internal\" (UID: \"130d71e16700185813be32f181bd7fb9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.478415 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.478414    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/981effb0bc761af34ac69e53b76f88ed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal\" (UID: \"981effb0bc761af34ac69e53b76f88ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.478601 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.478431    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/981effb0bc761af34ac69e53b76f88ed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal\" (UID: \"981effb0bc761af34ac69e53b76f88ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.541832 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.541804    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found"
Jul 28 20:24:46.579002 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.578972    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/981effb0bc761af34ac69e53b76f88ed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal\" (UID: \"981effb0bc761af34ac69e53b76f88ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.579072 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.579005    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/981effb0bc761af34ac69e53b76f88ed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal\" (UID: \"981effb0bc761af34ac69e53b76f88ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.579072 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.579019    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/130d71e16700185813be32f181bd7fb9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-26.ec2.internal\" (UID: \"130d71e16700185813be32f181bd7fb9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.579072 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.579069    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/981effb0bc761af34ac69e53b76f88ed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal\" (UID: \"981effb0bc761af34ac69e53b76f88ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.579164 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.579082    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/981effb0bc761af34ac69e53b76f88ed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal\" (UID: \"981effb0bc761af34ac69e53b76f88ed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.579164 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.579110    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/130d71e16700185813be32f181bd7fb9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-26.ec2.internal\" (UID: \"130d71e16700185813be32f181bd7fb9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.642557 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.642478    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found"
Jul 28 20:24:46.716174 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.716142    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.720324 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:46.720301    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal"
Jul 28 20:24:46.743094 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.742852    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found"
Jul 28 20:24:46.848067 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.848008    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found"
Jul 28 20:24:46.948952 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:46.948829    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found"
Jul 28 20:24:47.049018 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:47.048981    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found"
Jul 28 20:24:47.103514 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:47.103478    2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 20:24:47.104003 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:47.103662    2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 20:24:47.149905 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:47.149857    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found"
Jul 28 20:24:47.187938 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:47.187910    2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:24:47.224787 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:47.224662    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 20:19:46 +0000 UTC" deadline="2028-02-01 10:10:02.338637872 +0000 UTC"
Jul 28 20:24:47.224787 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:47.224722    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13261h45m15.113920639s"
Jul 28 20:24:47.275876 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:47.275841    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal"
Jul 28 20:24:47.292734 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:47.292709    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 20:24:47.294468 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:47.294447    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal"
Jul 28 20:24:47.305286 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:47.305261    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 20:24:47.492720 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:47.492676    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130d71e16700185813be32f181bd7fb9.slice/crio-fb39c3405d03830169596c2b338b33316a91d5dd4e6ed31068a072af49957341 WatchSource:0}: Error finding container fb39c3405d03830169596c2b338b33316a91d5dd4e6ed31068a072af49957341: Status 404 returned error can't find the container with id fb39c3405d03830169596c2b338b33316a91d5dd4e6ed31068a072af49957341
Jul 28 20:24:47.498780 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:47.498760    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:24:47.505884 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:47.505856    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod981effb0bc761af34ac69e53b76f88ed.slice/crio-0a98909287118e4004c3e4bee34f7406453b51bd5649cf5e912219ccbb5081f3 WatchSource:0}: Error finding container 0a98909287118e4004c3e4bee34f7406453b51bd5649cf5e912219ccbb5081f3: Status 404 returned error can't find the container with id 0a98909287118e4004c3e4bee34f7406453b51bd5649cf5e912219ccbb5081f3
Jul 28 20:24:47.610495 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:47.610459    2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:24:47.690408 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:47.690373    2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:24:48.149947 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.149906    2555 apiserver.go:52] "Watching apiserver"
Jul 28 20:24:48.159466 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.159432    2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 20:24:48.159918 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.159882    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-6s9n2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm","openshift-cluster-node-tuning-operator/tuned-qtm54","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal","openshift-multus/multus-additional-cni-plugins-jbmcj","openshift-network-diagnostics/network-check-target-dnptj","openshift-network-operator/iptables-alerter-xv4r5","openshift-ovn-kubernetes/ovnkube-node-5p8q6","kube-system/global-pull-secret-syncer-vm6v9","kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal","openshift-dns/node-resolver-jqxrq","openshift-image-registry/node-ca-b2hkw","openshift-multus/multus-lklpm","openshift-multus/network-metrics-daemon-kwz5g"]
Jul 28 20:24:48.162671 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.162647    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6s9n2"
Jul 28 20:24:48.165072 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.165046    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.167491 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.167465    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.168231 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.168205    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 20:24:48.168353 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.168244    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z2g6f\""
Jul 28 20:24:48.168353 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.168312    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 20:24:48.168474 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.168244    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 20:24:48.168616 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.168598    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-48fxh\""
Jul 28 20:24:48.168804 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.168789    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 20:24:48.168993 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.168975    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 20:24:48.169814 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.169791    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qrj4q\""
Jul 28 20:24:48.169905 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.169880    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:24:48.170038 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.170012    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 20:24:48.170914 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.170895    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.173194 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.172997    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 20:24:48.173559 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.173539    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 20:24:48.174300 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.174028    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:24:48.174300 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.174112    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:24:48.174476 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.174454    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vrljx\""
Jul 28 20:24:48.174576 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.174552    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 20:24:48.175079 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.175057    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 20:24:48.175378 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.175350    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 20:24:48.175483 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.175432    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 20:24:48.176721 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.176696    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xv4r5"
Jul 28 20:24:48.179464 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.179438    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.181061 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.181036    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:24:48.181217 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.181195    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2s5l5\""
Jul 28 20:24:48.181312 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.181284    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 20:24:48.181480 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.181456    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 20:24:48.181698 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.181675    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 20:24:48.181763 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.181727    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 20:24:48.181918 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.181904    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 20:24:48.182139 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.182119    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:48.182231 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.182200    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:24:48.182493 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.182472    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 20:24:48.182647 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.182621    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 20:24:48.183781 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.183757    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vxsh9\""
Jul 28 20:24:48.183923 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.183825    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 20:24:48.184759 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.184739    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jqxrq"
Jul 28 20:24:48.187481 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.187415    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b2hkw"
Jul 28 20:24:48.187610 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.187578    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 20:24:48.187610 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.187601    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dkcjj\""
Jul 28 20:24:48.187732 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.187683    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41b6e0d1-3694-49b1-b3b3-ce9ee043fb71-konnectivity-ca\") pod \"konnectivity-agent-6s9n2\" (UID: \"41b6e0d1-3694-49b1-b3b3-ce9ee043fb71\") " pod="kube-system/konnectivity-agent-6s9n2"
Jul 28 20:24:48.187732 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.187712    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-registration-dir\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.187861 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.187740    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-sysctl-conf\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.187861 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.187765    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-host\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.187861 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.187817    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f57ffa7-7757-453d-8caf-1bea550c1989-tmp\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.187861 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.187842    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-sysconfig\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.188101 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.187866    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-kubernetes\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.188101 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.187888    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-var-lib-kubelet\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.188101 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.187914    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvxv2\" (UniqueName: \"kubernetes.io/projected/0f57ffa7-7757-453d-8caf-1bea550c1989-kube-api-access-cvxv2\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.188101 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.187917    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 20:24:48.188101 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.187978    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16348271-59bd-4676-88d1-687829644944-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.188101 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188026    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljgtq\" (UniqueName: \"kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq\") pod \"network-check-target-dnptj\" (UID: \"8ef7b402-f97f-4996-b603-76ae46459289\") " pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:24:48.188101 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188084    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-device-dir\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.188498 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188200    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-etc-selinux\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.188498 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188239    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dfkq\" (UniqueName: \"kubernetes.io/projected/16348271-59bd-4676-88d1-687829644944-kube-api-access-9dfkq\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.188498 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188277    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhx4r\" (UniqueName: \"kubernetes.io/projected/73ecc0f8-563c-4668-88df-938f45859633-kube-api-access-dhx4r\") pod \"iptables-alerter-xv4r5\" (UID: \"73ecc0f8-563c-4668-88df-938f45859633\") " pod="openshift-network-operator/iptables-alerter-xv4r5"
Jul 28 20:24:48.188498 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188302    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-modprobe-d\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.188498 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188326    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16348271-59bd-4676-88d1-687829644944-system-cni-dir\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.188498 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188357    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73ecc0f8-563c-4668-88df-938f45859633-iptables-alerter-script\") pod \"iptables-alerter-xv4r5\" (UID: \"73ecc0f8-563c-4668-88df-938f45859633\") " pod="openshift-network-operator/iptables-alerter-xv4r5"
Jul 28 20:24:48.188498 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188381    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.188498 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188405    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-sysctl-d\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.188498 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188428    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-tuned\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.188498 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188452    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16348271-59bd-4676-88d1-687829644944-cnibin\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.188498 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188472    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16348271-59bd-4676-88d1-687829644944-cni-binary-copy\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.189123 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188515    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-sys-fs\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.189123 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188544    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73ecc0f8-563c-4668-88df-938f45859633-host-slash\") pod \"iptables-alerter-xv4r5\" (UID: \"73ecc0f8-563c-4668-88df-938f45859633\") " pod="openshift-network-operator/iptables-alerter-xv4r5"
Jul 28 20:24:48.189123 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188572    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41b6e0d1-3694-49b1-b3b3-ce9ee043fb71-agent-certs\") pod \"konnectivity-agent-6s9n2\" (UID: \"41b6e0d1-3694-49b1-b3b3-ce9ee043fb71\") " pod="kube-system/konnectivity-agent-6s9n2"
Jul 28 20:24:48.189123 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188598    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-socket-dir\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.189123 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188626    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vn9k\" (UniqueName: \"kubernetes.io/projected/48315261-2ed5-41b6-9188-67e903c99967-kube-api-access-6vn9k\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.189123 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188651    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-sys\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.189123 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188698    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16348271-59bd-4676-88d1-687829644944-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.189123 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188730    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-systemd\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.189123 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188758    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-run\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.189123 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188782    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-lib-modules\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.189123 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188799    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16348271-59bd-4676-88d1-687829644944-os-release\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.189123 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.188828    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16348271-59bd-4676-88d1-687829644944-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.190259 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.190237    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 20:24:48.190382 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.190337    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 20:24:48.191439 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.191142    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sk7x9\""
Jul 28 20:24:48.191439 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.191347    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 20:24:48.194109 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.191842    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.194219 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.194119    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 20:24:48.194817 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.194791    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hcqjg\""
Jul 28 20:24:48.194817 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.194794    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 20:24:48.195646 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.195619    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:24:48.195831 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.195761    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:24:48.218095 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.218061    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hz6cf"
Jul 28 20:24:48.227543 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.227514    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hz6cf"
Jul 28 20:24:48.277124 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.277095    2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 20:24:48.289808 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.289770    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-run\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.289998 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.289818    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-lib-modules\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.289998 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.289861    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16348271-59bd-4676-88d1-687829644944-os-release\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.289998 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.289893    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-slash\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.289998 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.289918    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-var-lib-openvswitch\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.289998 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.289946    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-run-ovn-kubernetes\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.289998 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.289976    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-env-overrides\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.290336 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290018    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-registration-dir\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.290336 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290021    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-run\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.290336 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290044    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-host\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.290336 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290094    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-host\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.290336 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290102    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-registration-dir\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.290336 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290101    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f57ffa7-7757-453d-8caf-1bea550c1989-tmp\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.290336 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290144    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-log-socket\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.290336 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290161    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-cni-netd\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.290336 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290177    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-ovnkube-config\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.290336 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290201    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-multus-cni-dir\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.290336 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290206    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16348271-59bd-4676-88d1-687829644944-os-release\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.290336 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290216    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-run-multus-certs\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.290336 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290304    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-kubernetes\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.290336 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290314    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-lib-modules\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.290336 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290341    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvxv2\" (UniqueName: \"kubernetes.io/projected/0f57ffa7-7757-453d-8caf-1bea550c1989-kube-api-access-cvxv2\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290369    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/476fb5e0-9429-4e20-b3ab-4ed2f7701c88-hosts-file\") pod \"node-resolver-jqxrq\" (UID: \"476fb5e0-9429-4e20-b3ab-4ed2f7701c88\") " pod="openshift-dns/node-resolver-jqxrq"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290392    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-kubernetes\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290394    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-system-cni-dir\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290449    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-var-lib-cni-bin\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290462    2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290481    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16348271-59bd-4676-88d1-687829644944-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290515    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljgtq\" (UniqueName: \"kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq\") pod \"network-check-target-dnptj\" (UID: \"8ef7b402-f97f-4996-b603-76ae46459289\") " pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290546    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-multus-daemon-config\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290571    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-device-dir\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290597    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-run-systemd\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290622    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-ovn-node-metrics-cert\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290647    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/476fb5e0-9429-4e20-b3ab-4ed2f7701c88-tmp-dir\") pod \"node-resolver-jqxrq\" (UID: \"476fb5e0-9429-4e20-b3ab-4ed2f7701c88\") " pod="openshift-dns/node-resolver-jqxrq"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290674    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v556q\" (UniqueName: \"kubernetes.io/projected/476fb5e0-9429-4e20-b3ab-4ed2f7701c88-kube-api-access-v556q\") pod \"node-resolver-jqxrq\" (UID: \"476fb5e0-9429-4e20-b3ab-4ed2f7701c88\") " pod="openshift-dns/node-resolver-jqxrq"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290698    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-run-netns\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290721    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-hostroot\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290748    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73ecc0f8-563c-4668-88df-938f45859633-iptables-alerter-script\") pod \"iptables-alerter-xv4r5\" (UID: \"73ecc0f8-563c-4668-88df-938f45859633\") " pod="openshift-network-operator/iptables-alerter-xv4r5"
Jul 28 20:24:48.291121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290773    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-device-dir\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290839    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.290781    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291111    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16348271-59bd-4676-88d1-687829644944-cnibin\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291139    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16348271-59bd-4676-88d1-687829644944-cni-binary-copy\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291169    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291197    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-multus-socket-dir-parent\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291225    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-etc-kubernetes\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291248    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-run-ovn\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291271    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-sys\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291297    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-kubelet\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291322    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-cni-binary-copy\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291345    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-multus-conf-dir\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291374    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16348271-59bd-4676-88d1-687829644944-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291405    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret\") pod \"global-pull-secret-syncer-vm6v9\" (UID: \"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34\") " pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291426    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73ecc0f8-563c-4668-88df-938f45859633-iptables-alerter-script\") pod \"iptables-alerter-xv4r5\" (UID: \"73ecc0f8-563c-4668-88df-938f45859633\") " pod="openshift-network-operator/iptables-alerter-xv4r5"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291430    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41b6e0d1-3694-49b1-b3b3-ce9ee043fb71-konnectivity-ca\") pod \"konnectivity-agent-6s9n2\" (UID: \"41b6e0d1-3694-49b1-b3b3-ce9ee043fb71\") " pod="kube-system/konnectivity-agent-6s9n2"
Jul 28 20:24:48.292067 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291494    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-sysctl-conf\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291514    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs\") pod \"network-metrics-daemon-kwz5g\" (UID: \"d6feb623-4784-4351-88a5-ed677f7c0ffb\") " pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291543    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1cc91af-e639-496c-a81f-84152a29f05c-host\") pod \"node-ca-b2hkw\" (UID: \"a1cc91af-e639-496c-a81f-84152a29f05c\") " pod="openshift-image-registry/node-ca-b2hkw"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291586    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-var-lib-kubelet\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291614    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-sysconfig\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291646    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-var-lib-kubelet\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291670    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb55d\" (UniqueName: \"kubernetes.io/projected/a1cc91af-e639-496c-a81f-84152a29f05c-kube-api-access-hb55d\") pod \"node-ca-b2hkw\" (UID: \"a1cc91af-e639-496c-a81f-84152a29f05c\") " pod="openshift-image-registry/node-ca-b2hkw"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291709    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-var-lib-cni-multus\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291742    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-run-netns\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291759    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-run-openvswitch\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291783    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-node-log\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291811    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-cni-bin\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291838    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-cnibin\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291863    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-os-release\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291888    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-run-k8s-cni-cncf-io\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291912    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-etc-selinux\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291929    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dfkq\" (UniqueName: \"kubernetes.io/projected/16348271-59bd-4676-88d1-687829644944-kube-api-access-9dfkq\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.292916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291951    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-etc-openvswitch\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291979    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjd5q\" (UniqueName: \"kubernetes.io/projected/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-kube-api-access-jjd5q\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292042    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cg7b\" (UniqueName: \"kubernetes.io/projected/d6feb623-4784-4351-88a5-ed677f7c0ffb-kube-api-access-2cg7b\") pod \"network-metrics-daemon-kwz5g\" (UID: \"d6feb623-4784-4351-88a5-ed677f7c0ffb\") " pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292068    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1cc91af-e639-496c-a81f-84152a29f05c-serviceca\") pod \"node-ca-b2hkw\" (UID: \"a1cc91af-e639-496c-a81f-84152a29f05c\") " pod="openshift-image-registry/node-ca-b2hkw"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292095    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhx4r\" (UniqueName: \"kubernetes.io/projected/73ecc0f8-563c-4668-88df-938f45859633-kube-api-access-dhx4r\") pod \"iptables-alerter-xv4r5\" (UID: \"73ecc0f8-563c-4668-88df-938f45859633\") " pod="openshift-network-operator/iptables-alerter-xv4r5"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292125    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-modprobe-d\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292107    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16348271-59bd-4676-88d1-687829644944-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292142    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16348271-59bd-4676-88d1-687829644944-system-cni-dir\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292191    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16348271-59bd-4676-88d1-687829644944-system-cni-dir\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292203    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkbs8\" (UniqueName: \"kubernetes.io/projected/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-kube-api-access-gkbs8\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292241    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-sysctl-d\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292267    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-tuned\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292296    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-kubelet-config\") pod \"global-pull-secret-syncer-vm6v9\" (UID: \"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34\") " pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292309    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-sysctl-conf\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292330    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-dbus\") pod \"global-pull-secret-syncer-vm6v9\" (UID: \"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34\") " pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292358    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-systemd-units\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292365    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-sysconfig\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.293798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292391    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-sys-fs\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292415    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-var-lib-kubelet\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292420    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73ecc0f8-563c-4668-88df-938f45859633-host-slash\") pod \"iptables-alerter-xv4r5\" (UID: \"73ecc0f8-563c-4668-88df-938f45859633\") " pod="openshift-network-operator/iptables-alerter-xv4r5"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292444    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16348271-59bd-4676-88d1-687829644944-cni-binary-copy\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292454    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41b6e0d1-3694-49b1-b3b3-ce9ee043fb71-agent-certs\") pod \"konnectivity-agent-6s9n2\" (UID: \"41b6e0d1-3694-49b1-b3b3-ce9ee043fb71\") " pod="kube-system/konnectivity-agent-6s9n2"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292528    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16348271-59bd-4676-88d1-687829644944-cnibin\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292594    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-modprobe-d\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292623    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-etc-selinux\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292648    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-sys-fs\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.291991    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41b6e0d1-3694-49b1-b3b3-ce9ee043fb71-konnectivity-ca\") pod \"konnectivity-agent-6s9n2\" (UID: \"41b6e0d1-3694-49b1-b3b3-ce9ee043fb71\") " pod="kube-system/konnectivity-agent-6s9n2"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292923    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-sysctl-d\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.292973    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-socket-dir\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.293021    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vn9k\" (UniqueName: \"kubernetes.io/projected/48315261-2ed5-41b6-9188-67e903c99967-kube-api-access-6vn9k\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.293045    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16348271-59bd-4676-88d1-687829644944-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.293076    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16348271-59bd-4676-88d1-687829644944-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.293090    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-ovnkube-script-lib\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.293114    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-systemd\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.294675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.293165    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-sys\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.295636 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.293200    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-systemd\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.295636 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.293607    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16348271-59bd-4676-88d1-687829644944-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.295636 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.293701    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/48315261-2ed5-41b6-9188-67e903c99967-socket-dir\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.295636 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.293905    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73ecc0f8-563c-4668-88df-938f45859633-host-slash\") pod \"iptables-alerter-xv4r5\" (UID: \"73ecc0f8-563c-4668-88df-938f45859633\") " pod="openshift-network-operator/iptables-alerter-xv4r5"
Jul 28 20:24:48.297185 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.297121    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" event={"ID":"981effb0bc761af34ac69e53b76f88ed","Type":"ContainerStarted","Data":"0a98909287118e4004c3e4bee34f7406453b51bd5649cf5e912219ccbb5081f3"}
Jul 28 20:24:48.298123 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.298098    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:24:48.298254 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.298134    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:24:48.298254 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.298149    2555 projected.go:196] Error preparing data for projected volume kube-api-access-ljgtq for pod openshift-network-diagnostics/network-check-target-dnptj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:24:48.298372 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.298292    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq podName:8ef7b402-f97f-4996-b603-76ae46459289 nodeName:}" failed. No retries permitted until 2026-07-28 20:24:48.798259348 +0000 UTC m=+3.043636045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ljgtq" (UniqueName: "kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq") pod "network-check-target-dnptj" (UID: "8ef7b402-f97f-4996-b603-76ae46459289") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:24:48.298645 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.298615    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal" event={"ID":"130d71e16700185813be32f181bd7fb9","Type":"ContainerStarted","Data":"fb39c3405d03830169596c2b338b33316a91d5dd4e6ed31068a072af49957341"}
Jul 28 20:24:48.299060 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.299036    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f57ffa7-7757-453d-8caf-1bea550c1989-etc-tuned\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.299162 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.299056    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f57ffa7-7757-453d-8caf-1bea550c1989-tmp\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.301096 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.300986    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41b6e0d1-3694-49b1-b3b3-ce9ee043fb71-agent-certs\") pod \"konnectivity-agent-6s9n2\" (UID: \"41b6e0d1-3694-49b1-b3b3-ce9ee043fb71\") " pod="kube-system/konnectivity-agent-6s9n2"
Jul 28 20:24:48.303977 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.303953    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvxv2\" (UniqueName: \"kubernetes.io/projected/0f57ffa7-7757-453d-8caf-1bea550c1989-kube-api-access-cvxv2\") pod \"tuned-qtm54\" (UID: \"0f57ffa7-7757-453d-8caf-1bea550c1989\") " pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.304477 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.304163    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:24:48.313837 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.313803    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dfkq\" (UniqueName: \"kubernetes.io/projected/16348271-59bd-4676-88d1-687829644944-kube-api-access-9dfkq\") pod \"multus-additional-cni-plugins-jbmcj\" (UID: \"16348271-59bd-4676-88d1-687829644944\") " pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.318668 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.318627    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhx4r\" (UniqueName: \"kubernetes.io/projected/73ecc0f8-563c-4668-88df-938f45859633-kube-api-access-dhx4r\") pod \"iptables-alerter-xv4r5\" (UID: \"73ecc0f8-563c-4668-88df-938f45859633\") " pod="openshift-network-operator/iptables-alerter-xv4r5"
Jul 28 20:24:48.320616 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.320588    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vn9k\" (UniqueName: \"kubernetes.io/projected/48315261-2ed5-41b6-9188-67e903c99967-kube-api-access-6vn9k\") pod \"aws-ebs-csi-driver-node-f97nm\" (UID: \"48315261-2ed5-41b6-9188-67e903c99967\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.394407 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394369    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-run-systemd\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.394619 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394417    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-ovn-node-metrics-cert\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.394619 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394459    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/476fb5e0-9429-4e20-b3ab-4ed2f7701c88-tmp-dir\") pod \"node-resolver-jqxrq\" (UID: \"476fb5e0-9429-4e20-b3ab-4ed2f7701c88\") " pod="openshift-dns/node-resolver-jqxrq"
Jul 28 20:24:48.394619 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394487    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-run-systemd\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.394619 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394494    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v556q\" (UniqueName: \"kubernetes.io/projected/476fb5e0-9429-4e20-b3ab-4ed2f7701c88-kube-api-access-v556q\") pod \"node-resolver-jqxrq\" (UID: \"476fb5e0-9429-4e20-b3ab-4ed2f7701c88\") " pod="openshift-dns/node-resolver-jqxrq"
Jul 28 20:24:48.394840 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394621    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-run-netns\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.394840 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394679    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-hostroot\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.394840 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394747    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.394840 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394781    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-run-netns\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.394840 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394781    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-multus-socket-dir-parent\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.395126 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394835    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-etc-kubernetes\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.395126 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394855    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-hostroot\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.395126 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394881    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-run-ovn\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.395126 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394917    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-kubelet\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.395126 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394949    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-cni-binary-copy\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.395126 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394931    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.395126 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395008    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-multus-conf-dir\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.395126 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.394882    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/476fb5e0-9429-4e20-b3ab-4ed2f7701c88-tmp-dir\") pod \"node-resolver-jqxrq\" (UID: \"476fb5e0-9429-4e20-b3ab-4ed2f7701c88\") " pod="openshift-dns/node-resolver-jqxrq"
Jul 28 20:24:48.395126 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395048    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret\") pod \"global-pull-secret-syncer-vm6v9\" (UID: \"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34\") " pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:48.395126 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395081    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-etc-kubernetes\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.395126 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395100    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs\") pod \"network-metrics-daemon-kwz5g\" (UID: \"d6feb623-4784-4351-88a5-ed677f7c0ffb\") " pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395134    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1cc91af-e639-496c-a81f-84152a29f05c-host\") pod \"node-ca-b2hkw\" (UID: \"a1cc91af-e639-496c-a81f-84152a29f05c\") " pod="openshift-image-registry/node-ca-b2hkw"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395167    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-var-lib-kubelet\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395172    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-multus-conf-dir\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395211    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb55d\" (UniqueName: \"kubernetes.io/projected/a1cc91af-e639-496c-a81f-84152a29f05c-kube-api-access-hb55d\") pod \"node-ca-b2hkw\" (UID: \"a1cc91af-e639-496c-a81f-84152a29f05c\") " pod="openshift-image-registry/node-ca-b2hkw"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395246    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-var-lib-cni-multus\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395278    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-run-netns\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395308    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-run-openvswitch\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395338    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-node-log\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395371    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-cni-bin\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395396    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-cnibin\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395422    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-os-release\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395449    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-run-k8s-cni-cncf-io\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395484    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-etc-openvswitch\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395516    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjd5q\" (UniqueName: \"kubernetes.io/projected/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-kube-api-access-jjd5q\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395573    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cg7b\" (UniqueName: \"kubernetes.io/projected/d6feb623-4784-4351-88a5-ed677f7c0ffb-kube-api-access-2cg7b\") pod \"network-metrics-daemon-kwz5g\" (UID: \"d6feb623-4784-4351-88a5-ed677f7c0ffb\") " pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395603    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1cc91af-e639-496c-a81f-84152a29f05c-serviceca\") pod \"node-ca-b2hkw\" (UID: \"a1cc91af-e639-496c-a81f-84152a29f05c\") " pod="openshift-image-registry/node-ca-b2hkw"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395637    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkbs8\" (UniqueName: \"kubernetes.io/projected/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-kube-api-access-gkbs8\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.395677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395669    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-kubelet-config\") pod \"global-pull-secret-syncer-vm6v9\" (UID: \"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34\") " pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395692    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-dbus\") pod \"global-pull-secret-syncer-vm6v9\" (UID: \"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34\") " pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395720    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-systemd-units\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395766    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-ovnkube-script-lib\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395798    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-slash\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395826    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-var-lib-openvswitch\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395826    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-cni-bin\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395868    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-run-ovn-kubernetes\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395882    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-cni-binary-copy\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395906    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-env-overrides\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.395984    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.396099    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret podName:4a04cb7b-6d7a-4c0b-a854-d12e6195bd34 nodeName:}" failed. No retries permitted until 2026-07-28 20:24:48.896063973 +0000 UTC m=+3.141440689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret") pod "global-pull-secret-syncer-vm6v9" (UID: "4a04cb7b-6d7a-4c0b-a854-d12e6195bd34") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.396245    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.396344    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs podName:d6feb623-4784-4351-88a5-ed677f7c0ffb nodeName:}" failed. No retries permitted until 2026-07-28 20:24:48.896303505 +0000 UTC m=+3.141680187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs") pod "network-metrics-daemon-kwz5g" (UID: "d6feb623-4784-4351-88a5-ed677f7c0ffb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396395    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1cc91af-e639-496c-a81f-84152a29f05c-host\") pod \"node-ca-b2hkw\" (UID: \"a1cc91af-e639-496c-a81f-84152a29f05c\") " pod="openshift-image-registry/node-ca-b2hkw"
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396397    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-var-lib-cni-multus\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395136    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-run-ovn\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.396652 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.395247    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-kubelet\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396463    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-log-socket\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396473    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-run-openvswitch\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396493    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-cni-netd\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396519    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-run-netns\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396521    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-ovnkube-config\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396561    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-var-lib-kubelet\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396577    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-env-overrides\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396591    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-multus-cni-dir\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396622    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-run-multus-certs\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396667    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-cnibin\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396674    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/476fb5e0-9429-4e20-b3ab-4ed2f7701c88-hosts-file\") pod \"node-resolver-jqxrq\" (UID: \"476fb5e0-9429-4e20-b3ab-4ed2f7701c88\") " pod="openshift-dns/node-resolver-jqxrq"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396703    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-system-cni-dir\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396734    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-var-lib-cni-bin\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396746    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-os-release\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396782    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-multus-daemon-config\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396821    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-run-k8s-cni-cncf-io\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.396939    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-etc-openvswitch\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.397516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.397031    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-node-log\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.398326 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.397098    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-ovnkube-config\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.398326 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.397160    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-log-socket\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.398326 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.397182    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-multus-cni-dir\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.398326 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.397205    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-cni-netd\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.398326 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.397289    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-multus-socket-dir-parent\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.400175 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.397588    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/476fb5e0-9429-4e20-b3ab-4ed2f7701c88-hosts-file\") pod \"node-resolver-jqxrq\" (UID: \"476fb5e0-9429-4e20-b3ab-4ed2f7701c88\") " pod="openshift-dns/node-resolver-jqxrq"
Jul 28 20:24:48.400175 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.399234    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-run-ovn-kubernetes\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.400175 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.399330    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-run-multus-certs\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.400175 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.399821    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-dbus\") pod \"global-pull-secret-syncer-vm6v9\" (UID: \"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34\") " pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:48.400175 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.399918    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-kubelet-config\") pod \"global-pull-secret-syncer-vm6v9\" (UID: \"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34\") " pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:48.400175 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.399928    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-systemd-units\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.400175 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.399992    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-system-cni-dir\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.400175 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.399997    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-host-var-lib-cni-bin\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.400175 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.400098    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-host-slash\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.400175 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.400157    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-ovnkube-script-lib\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.400763 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.400375    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-multus-daemon-config\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.400763 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.400655    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-ovn-node-metrics-cert\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.400982 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.400943    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-var-lib-openvswitch\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.403325 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.401903    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1cc91af-e639-496c-a81f-84152a29f05c-serviceca\") pod \"node-ca-b2hkw\" (UID: \"a1cc91af-e639-496c-a81f-84152a29f05c\") " pod="openshift-image-registry/node-ca-b2hkw"
Jul 28 20:24:48.407367 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.407337    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v556q\" (UniqueName: \"kubernetes.io/projected/476fb5e0-9429-4e20-b3ab-4ed2f7701c88-kube-api-access-v556q\") pod \"node-resolver-jqxrq\" (UID: \"476fb5e0-9429-4e20-b3ab-4ed2f7701c88\") " pod="openshift-dns/node-resolver-jqxrq"
Jul 28 20:24:48.407519 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.407448    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjd5q\" (UniqueName: \"kubernetes.io/projected/7ca39567-7c05-4c71-ab66-5ea47adb3cd9-kube-api-access-jjd5q\") pod \"ovnkube-node-5p8q6\" (UID: \"7ca39567-7c05-4c71-ab66-5ea47adb3cd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.412395 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.412366    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cg7b\" (UniqueName: \"kubernetes.io/projected/d6feb623-4784-4351-88a5-ed677f7c0ffb-kube-api-access-2cg7b\") pod \"network-metrics-daemon-kwz5g\" (UID: \"d6feb623-4784-4351-88a5-ed677f7c0ffb\") " pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:24:48.412532 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.412460    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkbs8\" (UniqueName: \"kubernetes.io/projected/ce5f7c34-50a9-492c-978c-c5ac9cdf74a3-kube-api-access-gkbs8\") pod \"multus-lklpm\" (UID: \"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3\") " pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.415179 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.415150    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb55d\" (UniqueName: \"kubernetes.io/projected/a1cc91af-e639-496c-a81f-84152a29f05c-kube-api-access-hb55d\") pod \"node-ca-b2hkw\" (UID: \"a1cc91af-e639-496c-a81f-84152a29f05c\") " pod="openshift-image-registry/node-ca-b2hkw"
Jul 28 20:24:48.476638 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.476587    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6s9n2"
Jul 28 20:24:48.487397 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.487233    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm"
Jul 28 20:24:48.488068 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:48.488039    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b6e0d1_3694_49b1_b3b3_ce9ee043fb71.slice/crio-e2616401c49a78499afc4dc5600e7eaece665874830e1209f5dbac34b1b753fa WatchSource:0}: Error finding container e2616401c49a78499afc4dc5600e7eaece665874830e1209f5dbac34b1b753fa: Status 404 returned error can't find the container with id e2616401c49a78499afc4dc5600e7eaece665874830e1209f5dbac34b1b753fa
Jul 28 20:24:48.496536 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.496511    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qtm54"
Jul 28 20:24:48.496959 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:48.496915    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48315261_2ed5_41b6_9188_67e903c99967.slice/crio-6eb46df3227a79469e47d3dabcf77862cf3ca5bd2382acf7ea54098189e1843b WatchSource:0}: Error finding container 6eb46df3227a79469e47d3dabcf77862cf3ca5bd2382acf7ea54098189e1843b: Status 404 returned error can't find the container with id 6eb46df3227a79469e47d3dabcf77862cf3ca5bd2382acf7ea54098189e1843b
Jul 28 20:24:48.504141 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.504099    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jbmcj"
Jul 28 20:24:48.512007 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.511974    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xv4r5"
Jul 28 20:24:48.520211 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.520183    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:24:48.527425 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.527216    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jqxrq"
Jul 28 20:24:48.534291 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.534263    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b2hkw"
Jul 28 20:24:48.541513 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.541483    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lklpm"
Jul 28 20:24:48.800661 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.800571    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljgtq\" (UniqueName: \"kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq\") pod \"network-check-target-dnptj\" (UID: \"8ef7b402-f97f-4996-b603-76ae46459289\") " pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:24:48.800848 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.800731    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:24:48.800848 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.800749    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:24:48.800848 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.800759    2555 projected.go:196] Error preparing data for projected volume kube-api-access-ljgtq for pod openshift-network-diagnostics/network-check-target-dnptj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:24:48.800848 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.800818    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq podName:8ef7b402-f97f-4996-b603-76ae46459289 nodeName:}" failed. No retries permitted until 2026-07-28 20:24:49.800798373 +0000 UTC m=+4.046175073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ljgtq" (UniqueName: "kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq") pod "network-check-target-dnptj" (UID: "8ef7b402-f97f-4996-b603-76ae46459289") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:24:48.902031 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.901995    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs\") pod \"network-metrics-daemon-kwz5g\" (UID: \"d6feb623-4784-4351-88a5-ed677f7c0ffb\") " pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:24:48.902212 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:48.902099    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret\") pod \"global-pull-secret-syncer-vm6v9\" (UID: \"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34\") " pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:48.902212 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.902127    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:24:48.902212 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.902199    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs podName:d6feb623-4784-4351-88a5-ed677f7c0ffb nodeName:}" failed. No retries permitted until 2026-07-28 20:24:49.902180491 +0000 UTC m=+4.147557173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs") pod "network-metrics-daemon-kwz5g" (UID: "d6feb623-4784-4351-88a5-ed677f7c0ffb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:24:48.902384 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.902213    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:24:48.902384 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:48.902267    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret podName:4a04cb7b-6d7a-4c0b-a854-d12e6195bd34 nodeName:}" failed. No retries permitted until 2026-07-28 20:24:49.902251417 +0000 UTC m=+4.147628099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret") pod "global-pull-secret-syncer-vm6v9" (UID: "4a04cb7b-6d7a-4c0b-a854-d12e6195bd34") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:24:49.231467 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:49.231373    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 20:19:48 +0000 UTC" deadline="2028-04-28 03:10:43.200071018 +0000 UTC"
Jul 28 20:24:49.231467 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:49.231423    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15342h45m53.968651627s"
Jul 28 20:24:49.290002 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:49.289960    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:24:49.290207 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:49.289968    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:24:49.290207 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:49.290098    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:24:49.290314 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:49.290219    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:24:49.301217 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:49.301174    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm" event={"ID":"48315261-2ed5-41b6-9188-67e903c99967","Type":"ContainerStarted","Data":"6eb46df3227a79469e47d3dabcf77862cf3ca5bd2382acf7ea54098189e1843b"}
Jul 28 20:24:49.302468 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:49.302442    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6s9n2" event={"ID":"41b6e0d1-3694-49b1-b3b3-ce9ee043fb71","Type":"ContainerStarted","Data":"e2616401c49a78499afc4dc5600e7eaece665874830e1209f5dbac34b1b753fa"}
Jul 28 20:24:49.682230 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:49.682195    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476fb5e0_9429_4e20_b3ab_4ed2f7701c88.slice/crio-0f686f5bac4aea3dc97df30d596d207cf74380cf9ff9354c7c65bcdaccd1be73 WatchSource:0}: Error finding container 0f686f5bac4aea3dc97df30d596d207cf74380cf9ff9354c7c65bcdaccd1be73: Status 404 returned error can't find the container with id 0f686f5bac4aea3dc97df30d596d207cf74380cf9ff9354c7c65bcdaccd1be73
Jul 28 20:24:49.690772 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:49.690723    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce5f7c34_50a9_492c_978c_c5ac9cdf74a3.slice/crio-96189f12a4f1254e4cd0edc2a96d2e7cf8f961271457a26231aaa83943665c69 WatchSource:0}: Error finding container 96189f12a4f1254e4cd0edc2a96d2e7cf8f961271457a26231aaa83943665c69: Status 404 returned error can't find the container with id 96189f12a4f1254e4cd0edc2a96d2e7cf8f961271457a26231aaa83943665c69
Jul 28 20:24:49.693517 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:49.693341    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ecc0f8_563c_4668_88df_938f45859633.slice/crio-f6731c646810a5cbb7b2ec849278c616c3af00124ec9ef2cbe8dc6faf3cae09b WatchSource:0}: Error finding container f6731c646810a5cbb7b2ec849278c616c3af00124ec9ef2cbe8dc6faf3cae09b: Status 404 returned error can't find the container with id f6731c646810a5cbb7b2ec849278c616c3af00124ec9ef2cbe8dc6faf3cae09b
Jul 28 20:24:49.694338 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:49.694293    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16348271_59bd_4676_88d1_687829644944.slice/crio-655ff53e53ee8785a44804b3646ce37686b6b54c84d25885becc231616bbf7ae WatchSource:0}: Error finding container 655ff53e53ee8785a44804b3646ce37686b6b54c84d25885becc231616bbf7ae: Status 404 returned error can't find the container with id 655ff53e53ee8785a44804b3646ce37686b6b54c84d25885becc231616bbf7ae
Jul 28 20:24:49.696569 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:24:49.696293    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1cc91af_e639_496c_a81f_84152a29f05c.slice/crio-124578f6b1c4b9b6a053b8759594b743b9b6f68543686bf33f24f1c51d2e0e5e WatchSource:0}: Error finding container 124578f6b1c4b9b6a053b8759594b743b9b6f68543686bf33f24f1c51d2e0e5e: Status 404 returned error can't find the container with id 124578f6b1c4b9b6a053b8759594b743b9b6f68543686bf33f24f1c51d2e0e5e
Jul 28 20:24:49.810128 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:49.810081    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljgtq\" (UniqueName: \"kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq\") pod \"network-check-target-dnptj\" (UID: \"8ef7b402-f97f-4996-b603-76ae46459289\") " pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:24:49.810304 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:49.810283    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:24:49.810358 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:49.810314    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:24:49.810358 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:49.810328    2555 projected.go:196] Error preparing data for projected volume kube-api-access-ljgtq for pod openshift-network-diagnostics/network-check-target-dnptj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:24:49.810445 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:49.810396    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq podName:8ef7b402-f97f-4996-b603-76ae46459289 nodeName:}" failed. No retries permitted until 2026-07-28 20:24:51.810374953 +0000 UTC m=+6.055751647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ljgtq" (UniqueName: "kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq") pod "network-check-target-dnptj" (UID: "8ef7b402-f97f-4996-b603-76ae46459289") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:24:49.911552 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:49.911499    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret\") pod \"global-pull-secret-syncer-vm6v9\" (UID: \"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34\") " pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:49.911552 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:49.911551    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs\") pod \"network-metrics-daemon-kwz5g\" (UID: \"d6feb623-4784-4351-88a5-ed677f7c0ffb\") " pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:24:49.911811 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:49.911681    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:24:49.911811 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:49.911765    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret podName:4a04cb7b-6d7a-4c0b-a854-d12e6195bd34 nodeName:}" failed. No retries permitted until 2026-07-28 20:24:51.911743277 +0000 UTC m=+6.157119971 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret") pod "global-pull-secret-syncer-vm6v9" (UID: "4a04cb7b-6d7a-4c0b-a854-d12e6195bd34") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:24:49.911922 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:49.911687    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:24:49.911922 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:49.911916    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs podName:d6feb623-4784-4351-88a5-ed677f7c0ffb nodeName:}" failed. No retries permitted until 2026-07-28 20:24:51.911894676 +0000 UTC m=+6.157271362 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs") pod "network-metrics-daemon-kwz5g" (UID: "d6feb623-4784-4351-88a5-ed677f7c0ffb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:24:50.232327 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:50.231909    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 20:19:48 +0000 UTC" deadline="2028-01-27 10:20:54.204698956 +0000 UTC"
Jul 28 20:24:50.232327 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:50.232254    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13141h56m3.972454224s"
Jul 28 20:24:50.298112 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:50.294547    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:50.298112 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:50.294762    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:24:50.314674 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:50.314628    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jqxrq" event={"ID":"476fb5e0-9429-4e20-b3ab-4ed2f7701c88","Type":"ContainerStarted","Data":"0f686f5bac4aea3dc97df30d596d207cf74380cf9ff9354c7c65bcdaccd1be73"}
Jul 28 20:24:50.331912 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:50.331810    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b2hkw" event={"ID":"a1cc91af-e639-496c-a81f-84152a29f05c","Type":"ContainerStarted","Data":"124578f6b1c4b9b6a053b8759594b743b9b6f68543686bf33f24f1c51d2e0e5e"}
Jul 28 20:24:50.341781 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:50.341735    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qtm54" event={"ID":"0f57ffa7-7757-453d-8caf-1bea550c1989","Type":"ContainerStarted","Data":"7f6b441ac44d6738e04866c851e134b77450b1e44c254d6a7d60c03a71d37ae3"}
Jul 28 20:24:50.358056 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:50.357989    2555 generic.go:356] "Generic (PLEG): container finished" podID="981effb0bc761af34ac69e53b76f88ed" containerID="9e8fce50d2edb079ab3421abd144d6156b0b37ffede6c2208e2129fcf0291953" exitCode=0
Jul 28 20:24:50.358255 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:50.358133    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" event={"ID":"981effb0bc761af34ac69e53b76f88ed","Type":"ContainerDied","Data":"9e8fce50d2edb079ab3421abd144d6156b0b37ffede6c2208e2129fcf0291953"}
Jul 28 20:24:50.372177 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:50.372136    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal" event={"ID":"130d71e16700185813be32f181bd7fb9","Type":"ContainerStarted","Data":"a972a3f3fa0ea2267342a66aa1e944d41406fafe1992bfab9fe91733efc0bda9"}
Jul 28 20:24:50.386034 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:50.385756    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xv4r5" event={"ID":"73ecc0f8-563c-4668-88df-938f45859633","Type":"ContainerStarted","Data":"f6731c646810a5cbb7b2ec849278c616c3af00124ec9ef2cbe8dc6faf3cae09b"}
Jul 28 20:24:50.393401 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:50.393361    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lklpm" event={"ID":"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3","Type":"ContainerStarted","Data":"96189f12a4f1254e4cd0edc2a96d2e7cf8f961271457a26231aaa83943665c69"}
Jul 28 20:24:50.405758 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:50.405636    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbmcj" event={"ID":"16348271-59bd-4676-88d1-687829644944","Type":"ContainerStarted","Data":"655ff53e53ee8785a44804b3646ce37686b6b54c84d25885becc231616bbf7ae"}
Jul 28 20:24:50.408850 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:50.407964    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6" event={"ID":"7ca39567-7c05-4c71-ab66-5ea47adb3cd9","Type":"ContainerStarted","Data":"f0cb6441414f4056dde2b72a9c30c08c168f8cf7a191943cebb93c06a0180893"}
Jul 28 20:24:51.289856 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:51.289750    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:24:51.290377 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:51.289978    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:24:51.290453 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:51.290422    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:24:51.290990 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:51.290523    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:24:51.831524 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:51.831462    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljgtq\" (UniqueName: \"kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq\") pod \"network-check-target-dnptj\" (UID: \"8ef7b402-f97f-4996-b603-76ae46459289\") " pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:24:51.831714 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:51.831677    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:24:51.831714 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:51.831707    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:24:51.831849 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:51.831721    2555 projected.go:196] Error preparing data for projected volume kube-api-access-ljgtq for pod openshift-network-diagnostics/network-check-target-dnptj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:24:51.831849 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:51.831792    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq podName:8ef7b402-f97f-4996-b603-76ae46459289 nodeName:}" failed. No retries permitted until 2026-07-28 20:24:55.831769083 +0000 UTC m=+10.077145783 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ljgtq" (UniqueName: "kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq") pod "network-check-target-dnptj" (UID: "8ef7b402-f97f-4996-b603-76ae46459289") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:24:51.933562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:51.932857    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret\") pod \"global-pull-secret-syncer-vm6v9\" (UID: \"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34\") " pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:51.933562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:51.932910    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs\") pod \"network-metrics-daemon-kwz5g\" (UID: \"d6feb623-4784-4351-88a5-ed677f7c0ffb\") " pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:24:51.933562 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:51.933111    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:24:51.933562 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:51.933185    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs podName:d6feb623-4784-4351-88a5-ed677f7c0ffb nodeName:}" failed. No retries permitted until 2026-07-28 20:24:55.933160697 +0000 UTC m=+10.178537387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs") pod "network-metrics-daemon-kwz5g" (UID: "d6feb623-4784-4351-88a5-ed677f7c0ffb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:24:51.933562 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:51.933393    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:24:51.933562 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:51.933449    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret podName:4a04cb7b-6d7a-4c0b-a854-d12e6195bd34 nodeName:}" failed. No retries permitted until 2026-07-28 20:24:55.933434529 +0000 UTC m=+10.178811227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret") pod "global-pull-secret-syncer-vm6v9" (UID: "4a04cb7b-6d7a-4c0b-a854-d12e6195bd34") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:24:52.290143 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:52.290052    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:52.290626 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:52.290199    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:24:53.290523 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:53.289766    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:24:53.290523 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:53.289922    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:24:53.290523 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:53.290020    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:24:53.290523 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:53.290119    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:24:54.292117 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:54.291559    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:54.292117 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:54.291716    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:24:55.289977 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:55.289944    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:24:55.290161 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:55.290084    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:24:55.290161 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:55.290110    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:24:55.290299 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:55.290235    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:24:55.867361 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:55.867332    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljgtq\" (UniqueName: \"kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq\") pod \"network-check-target-dnptj\" (UID: \"8ef7b402-f97f-4996-b603-76ae46459289\") " pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:24:55.867817 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:55.867457    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:24:55.867817 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:55.867471    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:24:55.867817 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:55.867481    2555 projected.go:196] Error preparing data for projected volume kube-api-access-ljgtq for pod openshift-network-diagnostics/network-check-target-dnptj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:24:55.867817 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:55.867522    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq podName:8ef7b402-f97f-4996-b603-76ae46459289 nodeName:}" failed. No retries permitted until 2026-07-28 20:25:03.867509523 +0000 UTC m=+18.112886207 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ljgtq" (UniqueName: "kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq") pod "network-check-target-dnptj" (UID: "8ef7b402-f97f-4996-b603-76ae46459289") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:24:55.968309 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:55.967685    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret\") pod \"global-pull-secret-syncer-vm6v9\" (UID: \"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34\") " pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:55.968309 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:55.967735    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs\") pod \"network-metrics-daemon-kwz5g\" (UID: \"d6feb623-4784-4351-88a5-ed677f7c0ffb\") " pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:24:55.968309 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:55.967869    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:24:55.968309 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:55.967947    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs podName:d6feb623-4784-4351-88a5-ed677f7c0ffb nodeName:}" failed. No retries permitted until 2026-07-28 20:25:03.967912841 +0000 UTC m=+18.213289541 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs") pod "network-metrics-daemon-kwz5g" (UID: "d6feb623-4784-4351-88a5-ed677f7c0ffb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:24:55.968309 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:55.968025    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:24:55.968309 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:55.968069    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret podName:4a04cb7b-6d7a-4c0b-a854-d12e6195bd34 nodeName:}" failed. No retries permitted until 2026-07-28 20:25:03.968057628 +0000 UTC m=+18.213434322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret") pod "global-pull-secret-syncer-vm6v9" (UID: "4a04cb7b-6d7a-4c0b-a854-d12e6195bd34") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:24:56.291428 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:56.290841    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:56.291428 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:56.290984    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:24:57.289844 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:57.289807    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:24:57.290307 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:57.289965    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:24:57.290307 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:57.290029    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:24:57.290307 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:57.290094    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:24:58.292264 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:58.292229    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:24:58.292700 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:58.292364    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:24:59.289193 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:59.289154    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:24:59.289354 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:24:59.289160    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:24:59.289354 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:59.289300    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:24:59.289462 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:24:59.289370    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:25:00.289439 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:00.289353    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:00.289859 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:00.289493    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:25:01.289827 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:01.289789    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:01.290259 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:01.289845    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:01.290259 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:01.289915    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:25:01.290259 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:01.290065    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:25:02.289577 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:02.289545    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:02.289730 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:02.289668    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:25:03.290135 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:03.290094    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:03.290688 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:03.290094    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:03.290688 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:03.290228    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:25:03.290688 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:03.290333    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:25:03.925661 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:03.925626    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljgtq\" (UniqueName: \"kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq\") pod \"network-check-target-dnptj\" (UID: \"8ef7b402-f97f-4996-b603-76ae46459289\") " pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:03.925823 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:03.925803    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:25:03.925823 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:03.925823    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:25:03.925900 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:03.925833    2555 projected.go:196] Error preparing data for projected volume kube-api-access-ljgtq for pod openshift-network-diagnostics/network-check-target-dnptj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:03.925900 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:03.925883    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq podName:8ef7b402-f97f-4996-b603-76ae46459289 nodeName:}" failed. No retries permitted until 2026-07-28 20:25:19.925870446 +0000 UTC m=+34.171247126 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ljgtq" (UniqueName: "kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq") pod "network-check-target-dnptj" (UID: "8ef7b402-f97f-4996-b603-76ae46459289") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:04.026423 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:04.026386    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret\") pod \"global-pull-secret-syncer-vm6v9\" (UID: \"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34\") " pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:04.026611 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:04.026438    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs\") pod \"network-metrics-daemon-kwz5g\" (UID: \"d6feb623-4784-4351-88a5-ed677f7c0ffb\") " pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:04.026611 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:04.026542    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:04.026611 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:04.026543    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:04.026611 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:04.026601    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs podName:d6feb623-4784-4351-88a5-ed677f7c0ffb nodeName:}" failed. No retries permitted until 2026-07-28 20:25:20.026585261 +0000 UTC m=+34.271961941 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs") pod "network-metrics-daemon-kwz5g" (UID: "d6feb623-4784-4351-88a5-ed677f7c0ffb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:04.026783 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:04.026618    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret podName:4a04cb7b-6d7a-4c0b-a854-d12e6195bd34 nodeName:}" failed. No retries permitted until 2026-07-28 20:25:20.026609202 +0000 UTC m=+34.271985881 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret") pod "global-pull-secret-syncer-vm6v9" (UID: "4a04cb7b-6d7a-4c0b-a854-d12e6195bd34") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:04.290122 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:04.290039    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:04.290266 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:04.290168    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:25:05.290101 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:05.290063    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:05.290298 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:05.290188    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:25:05.290298 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:05.290251    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:05.290733 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:05.290358    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:25:06.290646 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:06.290613    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:06.291153 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:06.290713    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:25:07.289426 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:07.289387    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:07.289600 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:07.289387    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:07.289600 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:07.289525    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:25:07.289600 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:07.289571    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:25:08.289562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.289125    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:08.290365 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:08.289669    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:25:08.445437 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.445353    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" event={"ID":"981effb0bc761af34ac69e53b76f88ed","Type":"ContainerStarted","Data":"2d658cb9cfd390c088a3876edfa1ba5f5489d359ccc705b530010cc5d83dfc7d"}
Jul 28 20:25:08.447125 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.447094    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm" event={"ID":"48315261-2ed5-41b6-9188-67e903c99967","Type":"ContainerStarted","Data":"e431f4953732c4cb2d3e6e296ad76955f91e47c8b928e04df7b4f33060d11ed7"}
Jul 28 20:25:08.448779 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.448750    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lklpm" event={"ID":"ce5f7c34-50a9-492c-978c-c5ac9cdf74a3","Type":"ContainerStarted","Data":"48ffbc54389bdc3b2c58d85cf7138090f4623f493bd898784ec41e1959aff72c"}
Jul 28 20:25:08.450652 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.450628    2555 generic.go:356] "Generic (PLEG): container finished" podID="16348271-59bd-4676-88d1-687829644944" containerID="feccf5df514c0fe41700cb01112b2e6e25ac9b94c8b7f45f1a870281e626587a" exitCode=0
Jul 28 20:25:08.450767 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.450702    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbmcj" event={"ID":"16348271-59bd-4676-88d1-687829644944","Type":"ContainerDied","Data":"feccf5df514c0fe41700cb01112b2e6e25ac9b94c8b7f45f1a870281e626587a"}
Jul 28 20:25:08.453844 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.453811    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6" event={"ID":"7ca39567-7c05-4c71-ab66-5ea47adb3cd9","Type":"ContainerStarted","Data":"2d851e7d70ca7b099bdf16d487bb6648eded384bf00c1467a8bdda096f25b5c2"}
Jul 28 20:25:08.453979 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.453874    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6" event={"ID":"7ca39567-7c05-4c71-ab66-5ea47adb3cd9","Type":"ContainerStarted","Data":"3668ba7cddd100b6acb997b8eea98892f27e595b4221e285a4042c512c67a945"}
Jul 28 20:25:08.453979 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.453921    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6" event={"ID":"7ca39567-7c05-4c71-ab66-5ea47adb3cd9","Type":"ContainerStarted","Data":"c58cbd414ca36144c393f03e5c562fc3169ed7b8defdde13661386250bab22f9"}
Jul 28 20:25:08.453979 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.453971    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6" event={"ID":"7ca39567-7c05-4c71-ab66-5ea47adb3cd9","Type":"ContainerStarted","Data":"ce139eb36d0131089890225893813063d0b60dcd66c700d15127c540939a2468"}
Jul 28 20:25:08.454105 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.453999    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6" event={"ID":"7ca39567-7c05-4c71-ab66-5ea47adb3cd9","Type":"ContainerStarted","Data":"a7d047f0baf38fa506a2578207f1d1e7456fa0544c0be8bc5ab2b0bd39a4afa4"}
Jul 28 20:25:08.454105 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.454033    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6" event={"ID":"7ca39567-7c05-4c71-ab66-5ea47adb3cd9","Type":"ContainerStarted","Data":"dd35f343a8c5021cbcbf64ea87d3b008f37c74095195ef05e515f06db105cec2"}
Jul 28 20:25:08.455264 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.455245    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jqxrq" event={"ID":"476fb5e0-9429-4e20-b3ab-4ed2f7701c88","Type":"ContainerStarted","Data":"ee98ef2734ec94b2989077f7ce744c6f8e8cf12d107252ca03d09cd0270a5639"}
Jul 28 20:25:08.456697 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.456672    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6s9n2" event={"ID":"41b6e0d1-3694-49b1-b3b3-ce9ee043fb71","Type":"ContainerStarted","Data":"2ab4878886aea278ef21f017a6cdc29dd016db5efd441a336a108d27bc7f2a71"}
Jul 28 20:25:08.458198 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.458174    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b2hkw" event={"ID":"a1cc91af-e639-496c-a81f-84152a29f05c","Type":"ContainerStarted","Data":"052a114ad711beb68d3565ed06b797b81caba880e3dc9273b9cd48571a861438"}
Jul 28 20:25:08.459457 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.459438    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qtm54" event={"ID":"0f57ffa7-7757-453d-8caf-1bea550c1989","Type":"ContainerStarted","Data":"c81d4b27cd2799b52d35b053ffb7ecca84cdc980434a116426e135d018dea591"}
Jul 28 20:25:08.461551 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.461518    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" podStartSLOduration=21.461509032 podStartE2EDuration="21.461509032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:24:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:08.461248227 +0000 UTC m=+22.706624930" watchObservedRunningTime="2026-07-28 20:25:08.461509032 +0000 UTC m=+22.706885735"
Jul 28 20:25:08.461838 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.461820    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal" podStartSLOduration=21.461814078 podStartE2EDuration="21.461814078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:24:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:24:50.402242173 +0000 UTC m=+4.647618881" watchObservedRunningTime="2026-07-28 20:25:08.461814078 +0000 UTC m=+22.707190779"
Jul 28 20:25:08.482443 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.482392    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lklpm" podStartSLOduration=3.482244694 podStartE2EDuration="21.482374532s" totalImagesPullingTime="18.000129838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:08.48227944 +0000 UTC m=+22.727656144" watchObservedRunningTime="2026-07-28 20:25:08.482374532 +0000 UTC m=+22.727751234"
Jul 28 20:25:08.530516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.530457    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jqxrq" podStartSLOduration=3.645799348 podStartE2EDuration="21.530440895s" totalImagesPullingTime="17.884641547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:08.497898807 +0000 UTC m=+22.743275512" watchObservedRunningTime="2026-07-28 20:25:08.530440895 +0000 UTC m=+22.775817654"
Jul 28 20:25:08.530693 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.530540    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b2hkw" podStartSLOduration=3.658208623 podStartE2EDuration="21.530536433s" totalImagesPullingTime="17.87232781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:08.529951463 +0000 UTC m=+22.775328161" watchObservedRunningTime="2026-07-28 20:25:08.530536433 +0000 UTC m=+22.775913134"
Jul 28 20:25:08.594688 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.594631    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6s9n2" podStartSLOduration=2.514096768 podStartE2EDuration="21.594612995s" totalImagesPullingTime="19.080516227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:08.579722636 +0000 UTC m=+22.825099337" watchObservedRunningTime="2026-07-28 20:25:08.594612995 +0000 UTC m=+22.839989749"
Jul 28 20:25:08.625843 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.625789    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qtm54" podStartSLOduration=3.690927228 podStartE2EDuration="21.625774325s" totalImagesPullingTime="17.934847097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:08.624433389 +0000 UTC m=+22.869810091" watchObservedRunningTime="2026-07-28 20:25:08.625774325 +0000 UTC m=+22.871151064"
Jul 28 20:25:08.746832 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:08.746812    2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 20:25:09.290110 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:09.290078    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:09.290575 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:09.290212    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:25:09.290575 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:09.290262    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:09.290575 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:09.290383    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:25:09.304747 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:09.304630    2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T20:25:08.746828288Z","UUID":"3280289e-2e7c-4c45-ab42-4ca5b75b38cc","Handler":null,"Name":"","Endpoint":""}
Jul 28 20:25:09.306307 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:09.306284    2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 20:25:09.306431 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:09.306327    2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 20:25:09.464003 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:09.463969    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm" event={"ID":"48315261-2ed5-41b6-9188-67e903c99967","Type":"ContainerStarted","Data":"d5f2284ce5e710f77e3064c1f4b230fd4286de62acb4d3812181aab974ce7223"}
Jul 28 20:25:09.465759 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:09.465641    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xv4r5" event={"ID":"73ecc0f8-563c-4668-88df-938f45859633","Type":"ContainerStarted","Data":"8b079bb680dafa1ce53c505f00f51087a45b45d78848c9f333855c371edd059c"}
Jul 28 20:25:09.486424 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:09.486331    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xv4r5" podStartSLOduration=4.557753245 podStartE2EDuration="22.486309789s" totalImagesPullingTime="17.928556544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:09.486200038 +0000 UTC m=+23.731576741" watchObservedRunningTime="2026-07-28 20:25:09.486309789 +0000 UTC m=+23.731686492"
Jul 28 20:25:10.290002 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:10.289974    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:10.290135 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:10.290108    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:25:10.472280 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:10.472240    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6" event={"ID":"7ca39567-7c05-4c71-ab66-5ea47adb3cd9","Type":"ContainerStarted","Data":"b21b8dfee2086400746a9236d5909637938d9cfd13ee38131c81ee525c99afcd"}
Jul 28 20:25:10.474537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:10.474506    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm" event={"ID":"48315261-2ed5-41b6-9188-67e903c99967","Type":"ContainerStarted","Data":"213e575ffa00fc8a260b789290f3e2ce2fdbda3542795f98ad5dd89c61dcda4b"}
Jul 28 20:25:11.290221 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:11.290020    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:11.290654 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:11.290032    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:11.290654 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:11.290333    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:25:11.290654 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:11.290406    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:25:12.293420 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:12.293388    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:12.293863 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:12.293520    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:25:12.334081 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:12.334062    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6s9n2"
Jul 28 20:25:12.334647 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:12.334627    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6s9n2"
Jul 28 20:25:12.351844 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:12.351798    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f97nm" podStartSLOduration=4.39682174 podStartE2EDuration="25.35178548s" totalImagesPullingTime="20.95496374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:24:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:10.493967154 +0000 UTC m=+24.739343860" watchObservedRunningTime="2026-07-28 20:25:12.35178548 +0000 UTC m=+26.597162183"
Jul 28 20:25:12.479069 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:12.479044    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6s9n2"
Jul 28 20:25:12.479511 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:12.479491    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6s9n2"
Jul 28 20:25:13.289654 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:13.289413    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:13.289654 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:13.289463    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:13.289846 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:13.289665    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:25:13.289846 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:13.289724    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:25:13.483001 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:13.482967    2555 generic.go:356] "Generic (PLEG): container finished" podID="16348271-59bd-4676-88d1-687829644944" containerID="38fef0904992bf99f2cc6e0cc8d66de427ff050cd548a460e87508b3ae27d641" exitCode=0
Jul 28 20:25:13.483877 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:13.483054    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbmcj" event={"ID":"16348271-59bd-4676-88d1-687829644944","Type":"ContainerDied","Data":"38fef0904992bf99f2cc6e0cc8d66de427ff050cd548a460e87508b3ae27d641"}
Jul 28 20:25:13.486869 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:13.486846    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6" event={"ID":"7ca39567-7c05-4c71-ab66-5ea47adb3cd9","Type":"ContainerStarted","Data":"a53e97e5f0811eca5f776cba2780afe73a28973f5dbb12c9505735fcaa45b23d"}
Jul 28 20:25:13.487162 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:13.487143    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:25:13.502370 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:13.502343    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:25:13.536108 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:13.536066    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6" podStartSLOduration=8.521922574 podStartE2EDuration="26.536051148s" totalImagesPullingTime="18.014128574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:13.535763079 +0000 UTC m=+27.781139780" watchObservedRunningTime="2026-07-28 20:25:13.536051148 +0000 UTC m=+27.781427849"
Jul 28 20:25:14.289668 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:14.289642    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:14.289871 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:14.289758    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:25:14.448786 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:14.448754    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dnptj"]
Jul 28 20:25:14.448959 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:14.448861    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:14.449009 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:14.448966    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:25:14.451308 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:14.451279    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vm6v9"]
Jul 28 20:25:14.452172 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:14.452138    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kwz5g"]
Jul 28 20:25:14.452279 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:14.452241    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:14.452355 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:14.452338    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:25:14.488904 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:14.488874    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:14.489341 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:14.488993    2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 20:25:14.489432 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:14.489407    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:25:14.489484 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:14.489458    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:25:14.504030 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:14.504000    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:25:15.493236 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:15.493204    2555 generic.go:356] "Generic (PLEG): container finished" podID="16348271-59bd-4676-88d1-687829644944" containerID="40ff726547a9ccfa3415be4885ab3ce1847d074afaf51e1e1b12b4ca84229e95" exitCode=0
Jul 28 20:25:15.493596 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:15.493288    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbmcj" event={"ID":"16348271-59bd-4676-88d1-687829644944","Type":"ContainerDied","Data":"40ff726547a9ccfa3415be4885ab3ce1847d074afaf51e1e1b12b4ca84229e95"}
Jul 28 20:25:15.493596 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:15.493347    2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 20:25:16.290636 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:16.290598    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:16.290788 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:16.290693    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:16.290788 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:16.290738    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:16.290788 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:16.290742    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:25:16.290905 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:16.290814    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:25:16.290954 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:16.290907    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:25:16.496112 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:16.496084    2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 20:25:17.416197 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:17.415973    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:25:17.428855 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:17.428805    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6" podUID="7ca39567-7c05-4c71-ab66-5ea47adb3cd9" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 28 20:25:17.437780 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:17.437745    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6" podUID="7ca39567-7c05-4c71-ab66-5ea47adb3cd9" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 28 20:25:17.501165 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:17.501132    2555 generic.go:356] "Generic (PLEG): container finished" podID="16348271-59bd-4676-88d1-687829644944" containerID="ee72ede08c1e8367f4a8ee85db3f11a670ee156b53214dd381340199c6f970bd" exitCode=0
Jul 28 20:25:17.501565 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:17.501214    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbmcj" event={"ID":"16348271-59bd-4676-88d1-687829644944","Type":"ContainerDied","Data":"ee72ede08c1e8367f4a8ee85db3f11a670ee156b53214dd381340199c6f970bd"}
Jul 28 20:25:17.511331 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:17.511302    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6" podUID="7ca39567-7c05-4c71-ab66-5ea47adb3cd9" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 28 20:25:18.289645 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:18.289618    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:18.289645 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:18.289646    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:18.289862 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:18.289619    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:18.289862 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:18.289749    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:25:18.289862 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:18.289821    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:25:18.290031 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:18.289881    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:25:19.946409 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:19.946369    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljgtq\" (UniqueName: \"kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq\") pod \"network-check-target-dnptj\" (UID: \"8ef7b402-f97f-4996-b603-76ae46459289\") " pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:19.946981 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:19.946512    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:25:19.946981 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:19.946534    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:25:19.946981 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:19.946547    2555 projected.go:196] Error preparing data for projected volume kube-api-access-ljgtq for pod openshift-network-diagnostics/network-check-target-dnptj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:19.946981 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:19.946614    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq podName:8ef7b402-f97f-4996-b603-76ae46459289 nodeName:}" failed. No retries permitted until 2026-07-28 20:25:51.946591699 +0000 UTC m=+66.191968394 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ljgtq" (UniqueName: "kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq") pod "network-check-target-dnptj" (UID: "8ef7b402-f97f-4996-b603-76ae46459289") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:20.047043 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.047008    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret\") pod \"global-pull-secret-syncer-vm6v9\" (UID: \"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34\") " pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:20.047043 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.047048    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs\") pod \"network-metrics-daemon-kwz5g\" (UID: \"d6feb623-4784-4351-88a5-ed677f7c0ffb\") " pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:20.047272 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.047165    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:20.047272 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.047171    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:20.047272 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.047216    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs podName:d6feb623-4784-4351-88a5-ed677f7c0ffb nodeName:}" failed. No retries permitted until 2026-07-28 20:25:52.047203062 +0000 UTC m=+66.292579742 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs") pod "network-metrics-daemon-kwz5g" (UID: "d6feb623-4784-4351-88a5-ed677f7c0ffb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:20.047272 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.047232    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret podName:4a04cb7b-6d7a-4c0b-a854-d12e6195bd34 nodeName:}" failed. No retries permitted until 2026-07-28 20:25:52.047223261 +0000 UTC m=+66.292599941 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret") pod "global-pull-secret-syncer-vm6v9" (UID: "4a04cb7b-6d7a-4c0b-a854-d12e6195bd34") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:20.289843 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.289631    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:20.289843 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.289785    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:20.289843 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.289807    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kwz5g" podUID="d6feb623-4784-4351-88a5-ed677f7c0ffb"
Jul 28 20:25:20.290115 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.289872    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vm6v9" podUID="4a04cb7b-6d7a-4c0b-a854-d12e6195bd34"
Jul 28 20:25:20.290115 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.289904    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:20.290115 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.290014    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnptj" podUID="8ef7b402-f97f-4996-b603-76ae46459289"
Jul 28 20:25:20.582908 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.582881    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeReady"
Jul 28 20:25:20.583071 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.583031    2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 20:25:20.616510 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.616474    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nhxhl"]
Jul 28 20:25:20.638419 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.638351    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-95c869d68-xqmpx"]
Jul 28 20:25:20.638611 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.638491    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nhxhl"
Jul 28 20:25:20.643195 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.641488    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 28 20:25:20.643195 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.641488    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:25:20.644846 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.643810    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lwxqh\""
Jul 28 20:25:20.652295 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.652157    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p"]
Jul 28 20:25:20.652424 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.652292    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.654705 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.654684    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 20:25:20.654705 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.654690    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-59v79\""
Jul 28 20:25:20.654943 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.654721    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 20:25:20.655078 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.655063    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 20:25:20.660848 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.660801    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 20:25:20.671105 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.670289    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p"]
Jul 28 20:25:20.671105 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.670431    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p"
Jul 28 20:25:20.673666 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.673262    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 28 20:25:20.673666 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.673286    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:25:20.673666 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.673538    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 28 20:25:20.673666 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.673565    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xtqtb\""
Jul 28 20:25:20.688332 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.688303    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"]
Jul 28 20:25:20.688466 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.688432    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p"
Jul 28 20:25:20.691340 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.691309    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 28 20:25:20.691472 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.691374    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 28 20:25:20.691561 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.691541    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 28 20:25:20.691624 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.691592    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fh5gh\""
Jul 28 20:25:20.691770 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.691748    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:25:20.702480 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.702453    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nhxhl"]
Jul 28 20:25:20.702583 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.702502    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p"]
Jul 28 20:25:20.702583 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.702535    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p"]
Jul 28 20:25:20.702583 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.702560    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-ndvkk"]
Jul 28 20:25:20.704676 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.704659    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:20.707198 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.707175    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 28 20:25:20.707768 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.707749    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-65s44\""
Jul 28 20:25:20.707913 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.707828    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 20:25:20.707913 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.707838    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 20:25:20.708745 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.708725    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 28 20:25:20.722520 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.722493    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f98b6fcdf-f69c6"]
Jul 28 20:25:20.722675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.722635    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:20.724816 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.724791    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:25:20.725022 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.724978    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 28 20:25:20.725163 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.725143    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 28 20:25:20.725260 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.725147    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 28 20:25:20.725557 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.725529    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wzcpr\""
Jul 28 20:25:20.730802 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.730783    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 28 20:25:20.746605 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.746571    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-whjpl"]
Jul 28 20:25:20.746749 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.746697    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:20.749060 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.749027    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 28 20:25:20.749060 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.749027    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 20:25:20.749263 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.749092    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 28 20:25:20.749353 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.749300    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 28 20:25:20.749468 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.749457    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f7z9m\""
Jul 28 20:25:20.749565 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.749471    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 28 20:25:20.749565 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.749471    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 20:25:20.751667 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.751645    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-bound-sa-token\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.751769 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.751686    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hchw6\" (UniqueName: \"kubernetes.io/projected/a5eaf18c-6121-41c0-8ab2-e98bb06b258f-kube-api-access-hchw6\") pod \"volume-data-source-validator-549c6d54cf-nhxhl\" (UID: \"a5eaf18c-6121-41c0-8ab2-e98bb06b258f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nhxhl"
Jul 28 20:25:20.751769 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.751734    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbd7039c-be85-49ee-bbab-f211b61ddaab-ca-trust-extracted\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.751876 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.751766    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-certificates\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.751876 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.751792    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbd7039c-be85-49ee-bbab-f211b61ddaab-installation-pull-secrets\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.751876 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.751834    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbd7039c-be85-49ee-bbab-f211b61ddaab-image-registry-private-configuration\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.752036 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.751888    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgdvv\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-kube-api-access-wgdvv\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.752036 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.751948    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vvj9\" (UniqueName: \"kubernetes.io/projected/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-kube-api-access-2vvj9\") pod \"cluster-samples-operator-6748489656-5gg9p\" (UID: \"a8baa7a6-16db-43fb-bac1-928e7df2f3aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p"
Jul 28 20:25:20.752036 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.751978    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5gg9p\" (UID: \"a8baa7a6-16db-43fb-bac1-928e7df2f3aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p"
Jul 28 20:25:20.752151 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.752080    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbd7039c-be85-49ee-bbab-f211b61ddaab-trusted-ca\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.752151 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.752121    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.762721 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.762697    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-95c869d68-xqmpx"]
Jul 28 20:25:20.762872 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.762731    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-zj7nr"]
Jul 28 20:25:20.762872 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.762841    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:20.765839 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.765814    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 20:25:20.765983 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.765866    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8kqlj\""
Jul 28 20:25:20.766280 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.766259    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 20:25:20.784761 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.784729    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d8pjr"]
Jul 28 20:25:20.784946 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.784844    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:20.787498 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.787471    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 28 20:25:20.787639 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.787503    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 28 20:25:20.787639 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.787506    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 20:25:20.787639 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.787565    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-j5jjt\""
Jul 28 20:25:20.787792 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.787705    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 20:25:20.793381 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.793359    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 28 20:25:20.808878 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.808845    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7"]
Jul 28 20:25:20.809070 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.809048    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d8pjr"
Jul 28 20:25:20.811365 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.811340    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 20:25:20.811503 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.811407    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 20:25:20.811503 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.811340    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ntb9d\""
Jul 28 20:25:20.811692 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.811651    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 20:25:20.815954 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.815364    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s9n2_41b6e0d1-3694-49b1-b3b3-ce9ee043fb71/konnectivity-agent/0.log" limit=1024
Jul 28 20:25:20.831120 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.831061    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-tl5xq"]
Jul 28 20:25:20.831296 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.831207    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7"
Jul 28 20:25:20.833760 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.833699    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nfjnh\""
Jul 28 20:25:20.833883 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.833709    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 28 20:25:20.833883 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.833841    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 28 20:25:20.834027 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.834006    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:25:20.834091 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.834009    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 28 20:25:20.852894 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.852867    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-default-certificate\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:20.853109 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.852904    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-bound-sa-token\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.853109 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.852926    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/08c5e2aa-c647-43ba-b193-2010926ef41d-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p\" (UID: \"08c5e2aa-c647-43ba-b193-2010926ef41d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p"
Jul 28 20:25:20.853109 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.852983    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/064d3b74-ea01-49c6-a3ec-b197a550242b-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-frl28\" (UID: \"064d3b74-ea01-49c6-a3ec-b197a550242b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:20.853109 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853004    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-ndvkk"]
Jul 28 20:25:20.853109 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853018    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz7bs\" (UniqueName: \"kubernetes.io/projected/08c5e2aa-c647-43ba-b193-2010926ef41d-kube-api-access-xz7bs\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p\" (UID: \"08c5e2aa-c647-43ba-b193-2010926ef41d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p"
Jul 28 20:25:20.853109 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853045    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"]
Jul 28 20:25:20.853109 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853069    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-whjpl"]
Jul 28 20:25:20.853109 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853087    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d8pjr"]
Jul 28 20:25:20.853109 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853046    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:20.853109 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853105    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f98b6fcdf-f69c6"]
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853120    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7"]
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853123    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d430e74f-09bd-48c4-903c-dba977c7db03-trusted-ca\") pod \"console-operator-584dcb6b54-ndvkk\" (UID: \"d430e74f-09bd-48c4-903c-dba977c7db03\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853140    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-zj7nr"]
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853149    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-certificates\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853185    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbd7039c-be85-49ee-bbab-f211b61ddaab-ca-trust-extracted\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853210    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853222    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-tl5xq"
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853238    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08c5e2aa-c647-43ba-b193-2010926ef41d-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p\" (UID: \"08c5e2aa-c647-43ba-b193-2010926ef41d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p"
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853262    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-tl5xq"]
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853267    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbtxn\" (UniqueName: \"kubernetes.io/projected/326f8187-7441-426a-b081-130b3e2a0bdb-kube-api-access-jbtxn\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853293    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjbxn\" (UniqueName: \"kubernetes.io/projected/a2663cb4-05c5-4954-8517-3c12845ada7a-kube-api-access-qjbxn\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853318    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d430e74f-09bd-48c4-903c-dba977c7db03-serving-cert\") pod \"console-operator-584dcb6b54-ndvkk\" (UID: \"d430e74f-09bd-48c4-903c-dba977c7db03\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853340    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853367    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbd7039c-be85-49ee-bbab-f211b61ddaab-trusted-ca\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853388    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-stats-auth\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853414    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853446    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hchw6\" (UniqueName: \"kubernetes.io/projected/a5eaf18c-6121-41c0-8ab2-e98bb06b258f-kube-api-access-hchw6\") pod \"volume-data-source-validator-549c6d54cf-nhxhl\" (UID: \"a5eaf18c-6121-41c0-8ab2-e98bb06b258f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nhxhl"
Jul 28 20:25:20.853525 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853467    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzdbb\" (UniqueName: \"kubernetes.io/projected/064d3b74-ea01-49c6-a3ec-b197a550242b-kube-api-access-mzdbb\") pod \"cluster-monitoring-operator-548b489cb8-frl28\" (UID: \"064d3b74-ea01-49c6-a3ec-b197a550242b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:20.854284 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853497    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbd7039c-be85-49ee-bbab-f211b61ddaab-installation-pull-secrets\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.854284 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853526    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vvj9\" (UniqueName: \"kubernetes.io/projected/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-kube-api-access-2vvj9\") pod \"cluster-samples-operator-6748489656-5gg9p\" (UID: \"a8baa7a6-16db-43fb-bac1-928e7df2f3aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p"
Jul 28 20:25:20.854284 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853562    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgdvv\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-kube-api-access-wgdvv\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.854284 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853583    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2663cb4-05c5-4954-8517-3c12845ada7a-config-volume\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:20.854284 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853605    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rfbd\" (UniqueName: \"kubernetes.io/projected/d430e74f-09bd-48c4-903c-dba977c7db03-kube-api-access-7rfbd\") pod \"console-operator-584dcb6b54-ndvkk\" (UID: \"d430e74f-09bd-48c4-903c-dba977c7db03\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:20.854284 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853645    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbd7039c-be85-49ee-bbab-f211b61ddaab-image-registry-private-configuration\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.854284 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853664    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbd7039c-be85-49ee-bbab-f211b61ddaab-ca-trust-extracted\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.854284 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853669    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2663cb4-05c5-4954-8517-3c12845ada7a-tmp-dir\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:20.854284 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853739    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d430e74f-09bd-48c4-903c-dba977c7db03-config\") pod \"console-operator-584dcb6b54-ndvkk\" (UID: \"d430e74f-09bd-48c4-903c-dba977c7db03\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:20.854284 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853779    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5gg9p\" (UID: \"a8baa7a6-16db-43fb-bac1-928e7df2f3aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p"
Jul 28 20:25:20.854284 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853807    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-frl28\" (UID: \"064d3b74-ea01-49c6-a3ec-b197a550242b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:20.854284 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.853815    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-certificates\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.854284 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.853972    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:25:20.854284 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.853973    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:25:20.854284 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.853994    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-95c869d68-xqmpx: secret "image-registry-tls" not found
Jul 28 20:25:20.854284 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.854065    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls podName:a8baa7a6-16db-43fb-bac1-928e7df2f3aa nodeName:}" failed. No retries permitted until 2026-07-28 20:25:21.354045689 +0000 UTC m=+35.599422382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls") pod "cluster-samples-operator-6748489656-5gg9p" (UID: "a8baa7a6-16db-43fb-bac1-928e7df2f3aa") : secret "samples-operator-tls" not found
Jul 28 20:25:20.854974 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.854086    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls podName:dbd7039c-be85-49ee-bbab-f211b61ddaab nodeName:}" failed. No retries permitted until 2026-07-28 20:25:21.354075681 +0000 UTC m=+35.599452388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls") pod "image-registry-95c869d68-xqmpx" (UID: "dbd7039c-be85-49ee-bbab-f211b61ddaab") : secret "image-registry-tls" not found
Jul 28 20:25:20.854974 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.854621    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbd7039c-be85-49ee-bbab-f211b61ddaab-trusted-ca\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.855840 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.855821    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 20:25:20.855974 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.855870    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-q4zhg\""
Jul 28 20:25:20.856233 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.856217    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 20:25:20.858668 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.858644    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbd7039c-be85-49ee-bbab-f211b61ddaab-image-registry-private-configuration\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.858763 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.858673    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbd7039c-be85-49ee-bbab-f211b61ddaab-installation-pull-secrets\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.861734 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.861707    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-bound-sa-token\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.862840 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.862817    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgdvv\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-kube-api-access-wgdvv\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:20.862955 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.862888    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hchw6\" (UniqueName: \"kubernetes.io/projected/a5eaf18c-6121-41c0-8ab2-e98bb06b258f-kube-api-access-hchw6\") pod \"volume-data-source-validator-549c6d54cf-nhxhl\" (UID: \"a5eaf18c-6121-41c0-8ab2-e98bb06b258f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nhxhl"
Jul 28 20:25:20.864077 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.864055    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vvj9\" (UniqueName: \"kubernetes.io/projected/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-kube-api-access-2vvj9\") pod \"cluster-samples-operator-6748489656-5gg9p\" (UID: \"a8baa7a6-16db-43fb-bac1-928e7df2f3aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p"
Jul 28 20:25:20.927673 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.927629    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s9n2_41b6e0d1-3694-49b1-b3b3-ce9ee043fb71/konnectivity-agent/0.log" limit=1024
Jul 28 20:25:20.954297 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.954263    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nhxhl"
Jul 28 20:25:20.954916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.954427    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:20.954916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.954459    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d430e74f-09bd-48c4-903c-dba977c7db03-trusted-ca\") pod \"console-operator-584dcb6b54-ndvkk\" (UID: \"d430e74f-09bd-48c4-903c-dba977c7db03\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:20.954916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.954483    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:20.954916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.954510    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8c3a22f-34cb-4baa-b9d8-d568862990f2-service-ca-bundle\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:20.954916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.954527    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kbj5\" (UniqueName: \"kubernetes.io/projected/b6dffdb7-1adc-4a33-86db-e77751cc4fb1-kube-api-access-7kbj5\") pod \"service-ca-operator-5d6c75f84f-5zvj7\" (UID: \"b6dffdb7-1adc-4a33-86db-e77751cc4fb1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7"
Jul 28 20:25:20.954916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.954548    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08c5e2aa-c647-43ba-b193-2010926ef41d-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p\" (UID: \"08c5e2aa-c647-43ba-b193-2010926ef41d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p"
Jul 28 20:25:20.954916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.954562    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2224b59c-8ed4-4bca-8286-9ae7d7227d4b-cert\") pod \"ingress-canary-d8pjr\" (UID: \"2224b59c-8ed4-4bca-8286-9ae7d7227d4b\") " pod="openshift-ingress-canary/ingress-canary-d8pjr"
Jul 28 20:25:20.954916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.954588    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbtxn\" (UniqueName: \"kubernetes.io/projected/326f8187-7441-426a-b081-130b3e2a0bdb-kube-api-access-jbtxn\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:20.954916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.954612    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsdjh\" (UniqueName: \"kubernetes.io/projected/e0e51108-1afa-4815-8a24-c87857531cd0-kube-api-access-rsdjh\") pod \"network-check-source-7d88cb55d8-tl5xq\" (UID: \"e0e51108-1afa-4815-8a24-c87857531cd0\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-tl5xq"
Jul 28 20:25:20.954916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.954635    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjbxn\" (UniqueName: \"kubernetes.io/projected/a2663cb4-05c5-4954-8517-3c12845ada7a-kube-api-access-qjbxn\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:20.954916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.954658    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d430e74f-09bd-48c4-903c-dba977c7db03-serving-cert\") pod \"console-operator-584dcb6b54-ndvkk\" (UID: \"d430e74f-09bd-48c4-903c-dba977c7db03\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:20.954916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.954677    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt4x7\" (UniqueName: \"kubernetes.io/projected/2224b59c-8ed4-4bca-8286-9ae7d7227d4b-kube-api-access-zt4x7\") pod \"ingress-canary-d8pjr\" (UID: \"2224b59c-8ed4-4bca-8286-9ae7d7227d4b\") " pod="openshift-ingress-canary/ingress-canary-d8pjr"
Jul 28 20:25:20.954916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.954702    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:20.954916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.954725    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8c3a22f-34cb-4baa-b9d8-d568862990f2-tmp\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:20.954916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.954749    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-stats-auth\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:20.954916 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.954846    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:25:20.955689 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.954968    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:25:20.955689 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.954975    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs podName:326f8187-7441-426a-b081-130b3e2a0bdb nodeName:}" failed. No retries permitted until 2026-07-28 20:25:21.45495401 +0000 UTC m=+35.700330693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs") pod "router-default-6f98b6fcdf-f69c6" (UID: "326f8187-7441-426a-b081-130b3e2a0bdb") : secret "router-metrics-certs-default" not found
Jul 28 20:25:20.955689 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.955066    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls podName:a2663cb4-05c5-4954-8517-3c12845ada7a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:21.45504499 +0000 UTC m=+35.700421678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls") pod "dns-default-whjpl" (UID: "a2663cb4-05c5-4954-8517-3c12845ada7a") : secret "dns-default-metrics-tls" not found
Jul 28 20:25:20.955689 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.955144    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8c3a22f-34cb-4baa-b9d8-d568862990f2-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:20.955689 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.955186    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b6dffdb7-1adc-4a33-86db-e77751cc4fb1-config\") pod \"service-ca-operator-5d6c75f84f-5zvj7\" (UID: \"b6dffdb7-1adc-4a33-86db-e77751cc4fb1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7"
Jul 28 20:25:20.955689 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.955235    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzdbb\" (UniqueName: \"kubernetes.io/projected/064d3b74-ea01-49c6-a3ec-b197a550242b-kube-api-access-mzdbb\") pod \"cluster-monitoring-operator-548b489cb8-frl28\" (UID: \"064d3b74-ea01-49c6-a3ec-b197a550242b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:20.955689 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.955261    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6dffdb7-1adc-4a33-86db-e77751cc4fb1-serving-cert\") pod \"service-ca-operator-5d6c75f84f-5zvj7\" (UID: \"b6dffdb7-1adc-4a33-86db-e77751cc4fb1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7"
Jul 28 20:25:20.955689 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.955365    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f8c3a22f-34cb-4baa-b9d8-d568862990f2-snapshots\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:20.955689 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.955481    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f8c3a22f-34cb-4baa-b9d8-d568862990f2-serving-cert\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:20.955689 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.955523    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2663cb4-05c5-4954-8517-3c12845ada7a-config-volume\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:20.955689 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.955553    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rfbd\" (UniqueName: \"kubernetes.io/projected/d430e74f-09bd-48c4-903c-dba977c7db03-kube-api-access-7rfbd\") pod \"console-operator-584dcb6b54-ndvkk\" (UID: \"d430e74f-09bd-48c4-903c-dba977c7db03\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:20.955689 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.955682    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2663cb4-05c5-4954-8517-3c12845ada7a-tmp-dir\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:20.955689 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.955701    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d430e74f-09bd-48c4-903c-dba977c7db03-config\") pod \"console-operator-584dcb6b54-ndvkk\" (UID: \"d430e74f-09bd-48c4-903c-dba977c7db03\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:20.956314 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.955733    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle podName:326f8187-7441-426a-b081-130b3e2a0bdb nodeName:}" failed. No retries permitted until 2026-07-28 20:25:21.455715736 +0000 UTC m=+35.701092438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle") pod "router-default-6f98b6fcdf-f69c6" (UID: "326f8187-7441-426a-b081-130b3e2a0bdb") : configmap references non-existent config key: service-ca.crt
Jul 28 20:25:20.956314 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.955776    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-frl28\" (UID: \"064d3b74-ea01-49c6-a3ec-b197a550242b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:20.956314 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.955820    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9z5t\" (UniqueName: \"kubernetes.io/projected/f8c3a22f-34cb-4baa-b9d8-d568862990f2-kube-api-access-w9z5t\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:20.956314 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.955829    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d430e74f-09bd-48c4-903c-dba977c7db03-trusted-ca\") pod \"console-operator-584dcb6b54-ndvkk\" (UID: \"d430e74f-09bd-48c4-903c-dba977c7db03\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:20.956314 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.955861    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-default-certificate\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:20.956314 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.955952    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:25:20.956314 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.955976    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/08c5e2aa-c647-43ba-b193-2010926ef41d-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p\" (UID: \"08c5e2aa-c647-43ba-b193-2010926ef41d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p"
Jul 28 20:25:20.956314 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.956005    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/064d3b74-ea01-49c6-a3ec-b197a550242b-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-frl28\" (UID: \"064d3b74-ea01-49c6-a3ec-b197a550242b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:20.956314 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.956035    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz7bs\" (UniqueName: \"kubernetes.io/projected/08c5e2aa-c647-43ba-b193-2010926ef41d-kube-api-access-xz7bs\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p\" (UID: \"08c5e2aa-c647-43ba-b193-2010926ef41d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p"
Jul 28 20:25:20.956314 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.956036    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2663cb4-05c5-4954-8517-3c12845ada7a-tmp-dir\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:20.956314 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:20.956088    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls podName:064d3b74-ea01-49c6-a3ec-b197a550242b nodeName:}" failed. No retries permitted until 2026-07-28 20:25:21.456071305 +0000 UTC m=+35.701447992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-frl28" (UID: "064d3b74-ea01-49c6-a3ec-b197a550242b") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:25:20.956925 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.956335    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2663cb4-05c5-4954-8517-3c12845ada7a-config-volume\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:20.956925 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.956355    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d430e74f-09bd-48c4-903c-dba977c7db03-config\") pod \"console-operator-584dcb6b54-ndvkk\" (UID: \"d430e74f-09bd-48c4-903c-dba977c7db03\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:20.956925 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.956552    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/08c5e2aa-c647-43ba-b193-2010926ef41d-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p\" (UID: \"08c5e2aa-c647-43ba-b193-2010926ef41d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p"
Jul 28 20:25:20.957070 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.956966    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/064d3b74-ea01-49c6-a3ec-b197a550242b-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-frl28\" (UID: \"064d3b74-ea01-49c6-a3ec-b197a550242b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:20.958092 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.958069    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08c5e2aa-c647-43ba-b193-2010926ef41d-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p\" (UID: \"08c5e2aa-c647-43ba-b193-2010926ef41d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p"
Jul 28 20:25:20.958331 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.958307    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-default-certificate\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:20.958740 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.958719    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d430e74f-09bd-48c4-903c-dba977c7db03-serving-cert\") pod \"console-operator-584dcb6b54-ndvkk\" (UID: \"d430e74f-09bd-48c4-903c-dba977c7db03\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:20.959752 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.959701    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-stats-auth\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:20.964677 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.964651    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbtxn\" (UniqueName: \"kubernetes.io/projected/326f8187-7441-426a-b081-130b3e2a0bdb-kube-api-access-jbtxn\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:20.965306 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.965242    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzdbb\" (UniqueName: \"kubernetes.io/projected/064d3b74-ea01-49c6-a3ec-b197a550242b-kube-api-access-mzdbb\") pod \"cluster-monitoring-operator-548b489cb8-frl28\" (UID: \"064d3b74-ea01-49c6-a3ec-b197a550242b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:20.965878 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.965856    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjbxn\" (UniqueName: \"kubernetes.io/projected/a2663cb4-05c5-4954-8517-3c12845ada7a-kube-api-access-qjbxn\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:20.966042 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.965965    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rfbd\" (UniqueName: \"kubernetes.io/projected/d430e74f-09bd-48c4-903c-dba977c7db03-kube-api-access-7rfbd\") pod \"console-operator-584dcb6b54-ndvkk\" (UID: \"d430e74f-09bd-48c4-903c-dba977c7db03\") " pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:20.966994 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.966975    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz7bs\" (UniqueName: \"kubernetes.io/projected/08c5e2aa-c647-43ba-b193-2010926ef41d-kube-api-access-xz7bs\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p\" (UID: \"08c5e2aa-c647-43ba-b193-2010926ef41d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p"
Jul 28 20:25:20.997429 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:20.997390    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p"
Jul 28 20:25:21.032733 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.032696    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:21.057205 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.057152    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8c3a22f-34cb-4baa-b9d8-d568862990f2-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:21.057205 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.057205    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b6dffdb7-1adc-4a33-86db-e77751cc4fb1-config\") pod \"service-ca-operator-5d6c75f84f-5zvj7\" (UID: \"b6dffdb7-1adc-4a33-86db-e77751cc4fb1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7"
Jul 28 20:25:21.057452 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.057236    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6dffdb7-1adc-4a33-86db-e77751cc4fb1-serving-cert\") pod \"service-ca-operator-5d6c75f84f-5zvj7\" (UID: \"b6dffdb7-1adc-4a33-86db-e77751cc4fb1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7"
Jul 28 20:25:21.057452 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.057266    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f8c3a22f-34cb-4baa-b9d8-d568862990f2-snapshots\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:21.057452 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.057295    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f8c3a22f-34cb-4baa-b9d8-d568862990f2-serving-cert\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:21.057452 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.057362    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9z5t\" (UniqueName: \"kubernetes.io/projected/f8c3a22f-34cb-4baa-b9d8-d568862990f2-kube-api-access-w9z5t\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:21.057798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.057761    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8c3a22f-34cb-4baa-b9d8-d568862990f2-service-ca-bundle\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:21.057905 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.057809    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kbj5\" (UniqueName: \"kubernetes.io/projected/b6dffdb7-1adc-4a33-86db-e77751cc4fb1-kube-api-access-7kbj5\") pod \"service-ca-operator-5d6c75f84f-5zvj7\" (UID: \"b6dffdb7-1adc-4a33-86db-e77751cc4fb1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7"
Jul 28 20:25:21.057905 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.057830    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b6dffdb7-1adc-4a33-86db-e77751cc4fb1-config\") pod \"service-ca-operator-5d6c75f84f-5zvj7\" (UID: \"b6dffdb7-1adc-4a33-86db-e77751cc4fb1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7"
Jul 28 20:25:21.057905 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.057837    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2224b59c-8ed4-4bca-8286-9ae7d7227d4b-cert\") pod \"ingress-canary-d8pjr\" (UID: \"2224b59c-8ed4-4bca-8286-9ae7d7227d4b\") " pod="openshift-ingress-canary/ingress-canary-d8pjr"
Jul 28 20:25:21.057905 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.057868    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsdjh\" (UniqueName: \"kubernetes.io/projected/e0e51108-1afa-4815-8a24-c87857531cd0-kube-api-access-rsdjh\") pod \"network-check-source-7d88cb55d8-tl5xq\" (UID: \"e0e51108-1afa-4815-8a24-c87857531cd0\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-tl5xq"
Jul 28 20:25:21.057905 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.057900    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt4x7\" (UniqueName: \"kubernetes.io/projected/2224b59c-8ed4-4bca-8286-9ae7d7227d4b-kube-api-access-zt4x7\") pod \"ingress-canary-d8pjr\" (UID: \"2224b59c-8ed4-4bca-8286-9ae7d7227d4b\") " pod="openshift-ingress-canary/ingress-canary-d8pjr"
Jul 28 20:25:21.058186 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.057958    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8c3a22f-34cb-4baa-b9d8-d568862990f2-tmp\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:21.058186 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.058096    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8c3a22f-34cb-4baa-b9d8-d568862990f2-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:21.058186 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.058105    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f8c3a22f-34cb-4baa-b9d8-d568862990f2-snapshots\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:21.058334 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.058252    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8c3a22f-34cb-4baa-b9d8-d568862990f2-tmp\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:21.058524 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.058499    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8c3a22f-34cb-4baa-b9d8-d568862990f2-service-ca-bundle\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:21.060035 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.060004    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6dffdb7-1adc-4a33-86db-e77751cc4fb1-serving-cert\") pod \"service-ca-operator-5d6c75f84f-5zvj7\" (UID: \"b6dffdb7-1adc-4a33-86db-e77751cc4fb1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7"
Jul 28 20:25:21.060256 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.060235    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f8c3a22f-34cb-4baa-b9d8-d568862990f2-serving-cert\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:21.060551 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.060528    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2224b59c-8ed4-4bca-8286-9ae7d7227d4b-cert\") pod \"ingress-canary-d8pjr\" (UID: \"2224b59c-8ed4-4bca-8286-9ae7d7227d4b\") " pod="openshift-ingress-canary/ingress-canary-d8pjr"
Jul 28 20:25:21.066512 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.066482    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kbj5\" (UniqueName: \"kubernetes.io/projected/b6dffdb7-1adc-4a33-86db-e77751cc4fb1-kube-api-access-7kbj5\") pod \"service-ca-operator-5d6c75f84f-5zvj7\" (UID: \"b6dffdb7-1adc-4a33-86db-e77751cc4fb1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7"
Jul 28 20:25:21.066653 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.066561    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt4x7\" (UniqueName: \"kubernetes.io/projected/2224b59c-8ed4-4bca-8286-9ae7d7227d4b-kube-api-access-zt4x7\") pod \"ingress-canary-d8pjr\" (UID: \"2224b59c-8ed4-4bca-8286-9ae7d7227d4b\") " pod="openshift-ingress-canary/ingress-canary-d8pjr"
Jul 28 20:25:21.066653 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.066587    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsdjh\" (UniqueName: \"kubernetes.io/projected/e0e51108-1afa-4815-8a24-c87857531cd0-kube-api-access-rsdjh\") pod \"network-check-source-7d88cb55d8-tl5xq\" (UID: \"e0e51108-1afa-4815-8a24-c87857531cd0\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-tl5xq"
Jul 28 20:25:21.066807 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.066787    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9z5t\" (UniqueName: \"kubernetes.io/projected/f8c3a22f-34cb-4baa-b9d8-d568862990f2-kube-api-access-w9z5t\") pod \"insights-operator-5885fdb759-zj7nr\" (UID: \"f8c3a22f-34cb-4baa-b9d8-d568862990f2\") " pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:21.097021 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.096919    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-zj7nr"
Jul 28 20:25:21.121239 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.121199    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d8pjr"
Jul 28 20:25:21.142997 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.142970    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7"
Jul 28 20:25:21.176743 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.176705    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-tl5xq"
Jul 28 20:25:21.361141 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.361060    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:21.361308 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.361231    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5gg9p\" (UID: \"a8baa7a6-16db-43fb-bac1-928e7df2f3aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p"
Jul 28 20:25:21.361308 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:21.361246    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:25:21.361308 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:21.361268    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-95c869d68-xqmpx: secret "image-registry-tls" not found
Jul 28 20:25:21.361447 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:21.361334    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls podName:dbd7039c-be85-49ee-bbab-f211b61ddaab nodeName:}" failed. No retries permitted until 2026-07-28 20:25:22.361311561 +0000 UTC m=+36.606688252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls") pod "image-registry-95c869d68-xqmpx" (UID: "dbd7039c-be85-49ee-bbab-f211b61ddaab") : secret "image-registry-tls" not found
Jul 28 20:25:21.361447 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:21.361367    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:25:21.361447 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:21.361420    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls podName:a8baa7a6-16db-43fb-bac1-928e7df2f3aa nodeName:}" failed. No retries permitted until 2026-07-28 20:25:22.361409241 +0000 UTC m=+36.606785933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls") pod "cluster-samples-operator-6748489656-5gg9p" (UID: "a8baa7a6-16db-43fb-bac1-928e7df2f3aa") : secret "samples-operator-tls" not found
Jul 28 20:25:21.462628 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.462589    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:21.462818 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.462652    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:21.462818 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.462762    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-frl28\" (UID: \"064d3b74-ea01-49c6-a3ec-b197a550242b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:21.462818 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:21.462796    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle podName:326f8187-7441-426a-b081-130b3e2a0bdb nodeName:}" failed. No retries permitted until 2026-07-28 20:25:22.462774026 +0000 UTC m=+36.708150705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle") pod "router-default-6f98b6fcdf-f69c6" (UID: "326f8187-7441-426a-b081-130b3e2a0bdb") : configmap references non-existent config key: service-ca.crt
Jul 28 20:25:21.463041 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:21.462833    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:25:21.463041 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:21.462863    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:21.463041 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:21.462892    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs podName:326f8187-7441-426a-b081-130b3e2a0bdb nodeName:}" failed. No retries permitted until 2026-07-28 20:25:22.462875183 +0000 UTC m=+36.708251879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs") pod "router-default-6f98b6fcdf-f69c6" (UID: "326f8187-7441-426a-b081-130b3e2a0bdb") : secret "router-metrics-certs-default" not found
Jul 28 20:25:21.463041 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:21.462914    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:25:21.463041 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:21.462839    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:25:21.463041 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:21.462961    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls podName:a2663cb4-05c5-4954-8517-3c12845ada7a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:22.462949331 +0000 UTC m=+36.708326013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls") pod "dns-default-whjpl" (UID: "a2663cb4-05c5-4954-8517-3c12845ada7a") : secret "dns-default-metrics-tls" not found
Jul 28 20:25:21.463041 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:21.463012    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls podName:064d3b74-ea01-49c6-a3ec-b197a550242b nodeName:}" failed. No retries permitted until 2026-07-28 20:25:22.462997053 +0000 UTC m=+36.708373738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-frl28" (UID: "064d3b74-ea01-49c6-a3ec-b197a550242b") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:25:22.290298 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.289969    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:22.291512 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.291089    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:22.291635 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.291614    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:22.295218 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.295194    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 20:25:22.296572 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.296215    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sn8zg\""
Jul 28 20:25:22.296572 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.296226    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 20:25:22.296572 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.296354    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9c5p9\""
Jul 28 20:25:22.342241 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.342122    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7"]
Jul 28 20:25:22.348544 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:22.348494    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6dffdb7_1adc_4a33_86db_e77751cc4fb1.slice/crio-ac41f1a293c8cbba46412082b1acff19b501149311f7ba1385539a4d9c0b8aea WatchSource:0}: Error finding container ac41f1a293c8cbba46412082b1acff19b501149311f7ba1385539a4d9c0b8aea: Status 404 returned error can't find the container with id ac41f1a293c8cbba46412082b1acff19b501149311f7ba1385539a4d9c0b8aea
Jul 28 20:25:22.355137 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.355114    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d8pjr"]
Jul 28 20:25:22.359379 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:22.358791    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2224b59c_8ed4_4bca_8286_9ae7d7227d4b.slice/crio-39ddb6e4494cd74fd39706e7d8cc72c6c477387900e531b048921d24ac84a665 WatchSource:0}: Error finding container 39ddb6e4494cd74fd39706e7d8cc72c6c477387900e531b048921d24ac84a665: Status 404 returned error can't find the container with id 39ddb6e4494cd74fd39706e7d8cc72c6c477387900e531b048921d24ac84a665
Jul 28 20:25:22.359379 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.359342    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-ndvkk"]
Jul 28 20:25:22.361199 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.361174    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-zj7nr"]
Jul 28 20:25:22.362374 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.362353    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-tl5xq"]
Jul 28 20:25:22.363095 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:22.362919    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c3a22f_34cb_4baa_b9d8_d568862990f2.slice/crio-c9ce6402644428cbf01d0aaa4c3bdfa75e1c02431f9a4faadd22d9a60f4c94a4 WatchSource:0}: Error finding container c9ce6402644428cbf01d0aaa4c3bdfa75e1c02431f9a4faadd22d9a60f4c94a4: Status 404 returned error can't find the container with id c9ce6402644428cbf01d0aaa4c3bdfa75e1c02431f9a4faadd22d9a60f4c94a4
Jul 28 20:25:22.363622 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.363605    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nhxhl"]
Jul 28 20:25:22.365279 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:22.365244    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd430e74f_09bd_48c4_903c_dba977c7db03.slice/crio-07228d2dcc787ba7322eb3906f4b130b0d966229946a45a08661272cadd1bf12 WatchSource:0}: Error finding container 07228d2dcc787ba7322eb3906f4b130b0d966229946a45a08661272cadd1bf12: Status 404 returned error can't find the container with id 07228d2dcc787ba7322eb3906f4b130b0d966229946a45a08661272cadd1bf12
Jul 28 20:25:22.366470 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:22.366449    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5eaf18c_6121_41c0_8ab2_e98bb06b258f.slice/crio-c8a78e2826a8fafe4b7090a8e40be62049ae172c55f22fbff5e7249ca7dea34a WatchSource:0}: Error finding container c8a78e2826a8fafe4b7090a8e40be62049ae172c55f22fbff5e7249ca7dea34a: Status 404 returned error can't find the container with id c8a78e2826a8fafe4b7090a8e40be62049ae172c55f22fbff5e7249ca7dea34a
Jul 28 20:25:22.367492 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:22.367251    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e51108_1afa_4815_8a24_c87857531cd0.slice/crio-3b6c8daa86986b3c8de49dfc8fba43e118fcb2af59f10e2e0cfc7639a5d7e70a WatchSource:0}: Error finding container 3b6c8daa86986b3c8de49dfc8fba43e118fcb2af59f10e2e0cfc7639a5d7e70a: Status 404 returned error can't find the container with id 3b6c8daa86986b3c8de49dfc8fba43e118fcb2af59f10e2e0cfc7639a5d7e70a
Jul 28 20:25:22.373222 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.373146    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p"]
Jul 28 20:25:22.377420 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.373484    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:22.377420 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.373569    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5gg9p\" (UID: \"a8baa7a6-16db-43fb-bac1-928e7df2f3aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p"
Jul 28 20:25:22.377420 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:22.373702    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:25:22.377420 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:22.373762    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls podName:a8baa7a6-16db-43fb-bac1-928e7df2f3aa nodeName:}" failed. No retries permitted until 2026-07-28 20:25:24.373745201 +0000 UTC m=+38.619121882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls") pod "cluster-samples-operator-6748489656-5gg9p" (UID: "a8baa7a6-16db-43fb-bac1-928e7df2f3aa") : secret "samples-operator-tls" not found
Jul 28 20:25:22.377420 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:22.373841    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:25:22.377420 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:22.373853    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-95c869d68-xqmpx: secret "image-registry-tls" not found
Jul 28 20:25:22.377420 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:22.373897    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls podName:dbd7039c-be85-49ee-bbab-f211b61ddaab nodeName:}" failed. No retries permitted until 2026-07-28 20:25:24.373883537 +0000 UTC m=+38.619260217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls") pod "image-registry-95c869d68-xqmpx" (UID: "dbd7039c-be85-49ee-bbab-f211b61ddaab") : secret "image-registry-tls" not found
Jul 28 20:25:22.474356 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.474319    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-frl28\" (UID: \"064d3b74-ea01-49c6-a3ec-b197a550242b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:22.474513 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.474381    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:22.474513 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.474413    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:22.474513 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:22.474423    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:25:22.474513 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.474439    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:22.474513 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:22.474491    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls podName:064d3b74-ea01-49c6-a3ec-b197a550242b nodeName:}" failed. No retries permitted until 2026-07-28 20:25:24.474473895 +0000 UTC m=+38.719850598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-frl28" (UID: "064d3b74-ea01-49c6-a3ec-b197a550242b") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:25:22.474706 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:22.474524    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:25:22.474706 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:22.474527    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:25:22.474706 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:22.474570    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs podName:326f8187-7441-426a-b081-130b3e2a0bdb nodeName:}" failed. No retries permitted until 2026-07-28 20:25:24.474555523 +0000 UTC m=+38.719932202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs") pod "router-default-6f98b6fcdf-f69c6" (UID: "326f8187-7441-426a-b081-130b3e2a0bdb") : secret "router-metrics-certs-default" not found
Jul 28 20:25:22.474706 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:22.474585    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle podName:326f8187-7441-426a-b081-130b3e2a0bdb nodeName:}" failed. No retries permitted until 2026-07-28 20:25:24.474578888 +0000 UTC m=+38.719955569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle") pod "router-default-6f98b6fcdf-f69c6" (UID: "326f8187-7441-426a-b081-130b3e2a0bdb") : configmap references non-existent config key: service-ca.crt
Jul 28 20:25:22.474706 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:22.474594    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls podName:a2663cb4-05c5-4954-8517-3c12845ada7a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:24.474589801 +0000 UTC m=+38.719966481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls") pod "dns-default-whjpl" (UID: "a2663cb4-05c5-4954-8517-3c12845ada7a") : secret "dns-default-metrics-tls" not found
Jul 28 20:25:22.515069 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.515033    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7" event={"ID":"b6dffdb7-1adc-4a33-86db-e77751cc4fb1","Type":"ContainerStarted","Data":"ac41f1a293c8cbba46412082b1acff19b501149311f7ba1385539a4d9c0b8aea"}
Jul 28 20:25:22.516076 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.516042    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk" event={"ID":"d430e74f-09bd-48c4-903c-dba977c7db03","Type":"ContainerStarted","Data":"07228d2dcc787ba7322eb3906f4b130b0d966229946a45a08661272cadd1bf12"}
Jul 28 20:25:22.517034 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.517014    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-tl5xq" event={"ID":"e0e51108-1afa-4815-8a24-c87857531cd0","Type":"ContainerStarted","Data":"3b6c8daa86986b3c8de49dfc8fba43e118fcb2af59f10e2e0cfc7639a5d7e70a"}
Jul 28 20:25:22.518080 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.518053    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p" event={"ID":"08c5e2aa-c647-43ba-b193-2010926ef41d","Type":"ContainerStarted","Data":"edf272d885c855a8c08dad02a123ca95c886031e4664a40a7f4d2d6ab5c37eb4"}
Jul 28 20:25:22.519189 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.519172    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-zj7nr" event={"ID":"f8c3a22f-34cb-4baa-b9d8-d568862990f2","Type":"ContainerStarted","Data":"c9ce6402644428cbf01d0aaa4c3bdfa75e1c02431f9a4faadd22d9a60f4c94a4"}
Jul 28 20:25:22.520200 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.520179    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nhxhl" event={"ID":"a5eaf18c-6121-41c0-8ab2-e98bb06b258f","Type":"ContainerStarted","Data":"c8a78e2826a8fafe4b7090a8e40be62049ae172c55f22fbff5e7249ca7dea34a"}
Jul 28 20:25:22.521217 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.521190    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d8pjr" event={"ID":"2224b59c-8ed4-4bca-8286-9ae7d7227d4b","Type":"ContainerStarted","Data":"39ddb6e4494cd74fd39706e7d8cc72c6c477387900e531b048921d24ac84a665"}
Jul 28 20:25:22.523797 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:22.523778    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbmcj" event={"ID":"16348271-59bd-4676-88d1-687829644944","Type":"ContainerStarted","Data":"90e66753d6f942d5380af484515b5b7a17ee5d1a4429ee43c3fba67e4e9395d7"}
Jul 28 20:25:23.534505 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:23.533568    2555 generic.go:356] "Generic (PLEG): container finished" podID="16348271-59bd-4676-88d1-687829644944" containerID="90e66753d6f942d5380af484515b5b7a17ee5d1a4429ee43c3fba67e4e9395d7" exitCode=0
Jul 28 20:25:23.534505 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:23.533621    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbmcj" event={"ID":"16348271-59bd-4676-88d1-687829644944","Type":"ContainerDied","Data":"90e66753d6f942d5380af484515b5b7a17ee5d1a4429ee43c3fba67e4e9395d7"}
Jul 28 20:25:24.393196 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:24.393156    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:24.393371 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:24.393252    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5gg9p\" (UID: \"a8baa7a6-16db-43fb-bac1-928e7df2f3aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p"
Jul 28 20:25:24.393445 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:24.393381    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:25:24.393498 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:24.393445    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls podName:a8baa7a6-16db-43fb-bac1-928e7df2f3aa nodeName:}" failed. No retries permitted until 2026-07-28 20:25:28.393425788 +0000 UTC m=+42.638802471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls") pod "cluster-samples-operator-6748489656-5gg9p" (UID: "a8baa7a6-16db-43fb-bac1-928e7df2f3aa") : secret "samples-operator-tls" not found
Jul 28 20:25:24.393880 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:24.393858    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:25:24.393880 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:24.393881    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-95c869d68-xqmpx: secret "image-registry-tls" not found
Jul 28 20:25:24.394086 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:24.393926    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls podName:dbd7039c-be85-49ee-bbab-f211b61ddaab nodeName:}" failed. No retries permitted until 2026-07-28 20:25:28.393910342 +0000 UTC m=+42.639287022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls") pod "image-registry-95c869d68-xqmpx" (UID: "dbd7039c-be85-49ee-bbab-f211b61ddaab") : secret "image-registry-tls" not found
Jul 28 20:25:24.495398 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:24.494171    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:24.495398 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:24.494243    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:24.495398 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:24.494289    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:24.495398 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:24.494392    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-frl28\" (UID: \"064d3b74-ea01-49c6-a3ec-b197a550242b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:24.495398 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:24.494648    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:25:24.495398 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:24.494715    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls podName:064d3b74-ea01-49c6-a3ec-b197a550242b nodeName:}" failed. No retries permitted until 2026-07-28 20:25:28.49469708 +0000 UTC m=+42.740073771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-frl28" (UID: "064d3b74-ea01-49c6-a3ec-b197a550242b") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:25:24.495398 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:24.495090    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle podName:326f8187-7441-426a-b081-130b3e2a0bdb nodeName:}" failed. No retries permitted until 2026-07-28 20:25:28.495064723 +0000 UTC m=+42.740441406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle") pod "router-default-6f98b6fcdf-f69c6" (UID: "326f8187-7441-426a-b081-130b3e2a0bdb") : configmap references non-existent config key: service-ca.crt
Jul 28 20:25:24.495398 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:24.495169    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:25:24.495398 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:24.495242    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls podName:a2663cb4-05c5-4954-8517-3c12845ada7a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:28.495228547 +0000 UTC m=+42.740605244 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls") pod "dns-default-whjpl" (UID: "a2663cb4-05c5-4954-8517-3c12845ada7a") : secret "dns-default-metrics-tls" not found
Jul 28 20:25:24.495398 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:24.495311    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:25:24.495398 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:24.495368    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs podName:326f8187-7441-426a-b081-130b3e2a0bdb nodeName:}" failed. No retries permitted until 2026-07-28 20:25:28.495355925 +0000 UTC m=+42.740732609 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs") pod "router-default-6f98b6fcdf-f69c6" (UID: "326f8187-7441-426a-b081-130b3e2a0bdb") : secret "router-metrics-certs-default" not found
Jul 28 20:25:24.554758 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:24.554720    2555 generic.go:356] "Generic (PLEG): container finished" podID="16348271-59bd-4676-88d1-687829644944" containerID="45c485222227b1bd01e853756293c08974ad1e2f4e81647aa80ff6ff9bab2dd0" exitCode=0
Jul 28 20:25:24.555207 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:24.554825    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbmcj" event={"ID":"16348271-59bd-4676-88d1-687829644944","Type":"ContainerDied","Data":"45c485222227b1bd01e853756293c08974ad1e2f4e81647aa80ff6ff9bab2dd0"}
Jul 28 20:25:25.561425 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:25.561238    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbmcj" event={"ID":"16348271-59bd-4676-88d1-687829644944","Type":"ContainerStarted","Data":"f5df325c57a95af4f24eb64cba7cd7e0b73c0a03b3b45197e11522e20e5f8507"}
Jul 28 20:25:25.584310 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:25.584261    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jbmcj" podStartSLOduration=9.400267946 podStartE2EDuration="38.584243934s" totalImagesPullingTime="29.183975988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:24:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:25.582488302 +0000 UTC m=+39.827865005" watchObservedRunningTime="2026-07-28 20:25:25.584243934 +0000 UTC m=+39.829620638"
Jul 28 20:25:25.704171 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:25.704111    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s9n2_41b6e0d1-3694-49b1-b3b3-ce9ee043fb71/konnectivity-agent/0.log" limit=1024
Jul 28 20:25:25.804251 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:25.804169    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s9n2_41b6e0d1-3694-49b1-b3b3-ce9ee043fb71/konnectivity-agent/0.log" limit=1024
Jul 28 20:25:25.906359 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:25.906322    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s9n2_41b6e0d1-3694-49b1-b3b3-ce9ee043fb71/konnectivity-agent/0.log" limit=1024
Jul 28 20:25:26.185739 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:26.185707    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s9n2_41b6e0d1-3694-49b1-b3b3-ce9ee043fb71/konnectivity-agent/0.log" limit=1024
Jul 28 20:25:26.250338 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:26.250287    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s9n2_41b6e0d1-3694-49b1-b3b3-ce9ee043fb71/konnectivity-agent/0.log" limit=1024
Jul 28 20:25:27.705387 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:27.705347    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s9n2_41b6e0d1-3694-49b1-b3b3-ce9ee043fb71/konnectivity-agent/0.log" limit=1024
Jul 28 20:25:27.763741 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:27.763702    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6s9n2_41b6e0d1-3694-49b1-b3b3-ce9ee043fb71/konnectivity-agent/0.log" limit=1024
Jul 28 20:25:28.431527 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:28.431492    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:28.431698 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:28.431559    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5gg9p\" (UID: \"a8baa7a6-16db-43fb-bac1-928e7df2f3aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p"
Jul 28 20:25:28.431698 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:28.431661    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:25:28.431698 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:28.431685    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-95c869d68-xqmpx: secret "image-registry-tls" not found
Jul 28 20:25:28.431866 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:28.431724    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 20:25:28.431866 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:28.431748    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls podName:dbd7039c-be85-49ee-bbab-f211b61ddaab nodeName:}" failed. No retries permitted until 2026-07-28 20:25:36.431732927 +0000 UTC m=+50.677109613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls") pod "image-registry-95c869d68-xqmpx" (UID: "dbd7039c-be85-49ee-bbab-f211b61ddaab") : secret "image-registry-tls" not found
Jul 28 20:25:28.431866 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:28.431788    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls podName:a8baa7a6-16db-43fb-bac1-928e7df2f3aa nodeName:}" failed. No retries permitted until 2026-07-28 20:25:36.431768827 +0000 UTC m=+50.677145512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls") pod "cluster-samples-operator-6748489656-5gg9p" (UID: "a8baa7a6-16db-43fb-bac1-928e7df2f3aa") : secret "samples-operator-tls" not found
Jul 28 20:25:28.532499 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:28.532453    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:28.532692 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:28.532518    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:28.532692 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:28.532624    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:25:28.532692 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:28.532662    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle podName:326f8187-7441-426a-b081-130b3e2a0bdb nodeName:}" failed. No retries permitted until 2026-07-28 20:25:36.532638761 +0000 UTC m=+50.778015447 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle") pod "router-default-6f98b6fcdf-f69c6" (UID: "326f8187-7441-426a-b081-130b3e2a0bdb") : configmap references non-existent config key: service-ca.crt
Jul 28 20:25:28.532692 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:28.532693    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs podName:326f8187-7441-426a-b081-130b3e2a0bdb nodeName:}" failed. No retries permitted until 2026-07-28 20:25:36.532683821 +0000 UTC m=+50.778060501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs") pod "router-default-6f98b6fcdf-f69c6" (UID: "326f8187-7441-426a-b081-130b3e2a0bdb") : secret "router-metrics-certs-default" not found
Jul 28 20:25:28.532904 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:28.532816    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-frl28\" (UID: \"064d3b74-ea01-49c6-a3ec-b197a550242b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:28.532904 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:28.532875    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:28.533026 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:28.532947    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:25:28.533026 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:28.532978    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:25:28.533026 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:28.533002    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls podName:064d3b74-ea01-49c6-a3ec-b197a550242b nodeName:}" failed. No retries permitted until 2026-07-28 20:25:36.532987303 +0000 UTC m=+50.778363989 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-frl28" (UID: "064d3b74-ea01-49c6-a3ec-b197a550242b") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:25:28.533026 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:28.533018    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls podName:a2663cb4-05c5-4954-8517-3c12845ada7a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:36.533009817 +0000 UTC m=+50.778386497 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls") pod "dns-default-whjpl" (UID: "a2663cb4-05c5-4954-8517-3c12845ada7a") : secret "dns-default-metrics-tls" not found
Jul 28 20:25:30.577262 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:30.577220    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7" event={"ID":"b6dffdb7-1adc-4a33-86db-e77751cc4fb1","Type":"ContainerStarted","Data":"56299ae36f0238ab8f14426459d0f5fa2b6bb47a492e9d63ab8bf4728aff1275"}
Jul 28 20:25:30.579547 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:30.579525    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/0.log"
Jul 28 20:25:30.579684 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:30.579567    2555 generic.go:356] "Generic (PLEG): container finished" podID="d430e74f-09bd-48c4-903c-dba977c7db03" containerID="617d92a9f4ed7b275432199dca143c3c1c1a8d2fbe7777faee1828dc784d57ac" exitCode=255
Jul 28 20:25:30.579684 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:30.579641    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk" event={"ID":"d430e74f-09bd-48c4-903c-dba977c7db03","Type":"ContainerDied","Data":"617d92a9f4ed7b275432199dca143c3c1c1a8d2fbe7777faee1828dc784d57ac"}
Jul 28 20:25:30.579850 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:30.579826    2555 scope.go:117] "RemoveContainer" containerID="617d92a9f4ed7b275432199dca143c3c1c1a8d2fbe7777faee1828dc784d57ac"
Jul 28 20:25:30.581679 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:30.581346    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-tl5xq" event={"ID":"e0e51108-1afa-4815-8a24-c87857531cd0","Type":"ContainerStarted","Data":"bd06cb83a0db555a7982ae216492fdbc55b4556c0c5565a2f4ae0930999a31a5"}
Jul 28 20:25:30.583227 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:30.583177    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p" event={"ID":"08c5e2aa-c647-43ba-b193-2010926ef41d","Type":"ContainerStarted","Data":"d89953f238f58d528126a4791f7b36a9d8228ae3169cc0623dd7c0bf51816e67"}
Jul 28 20:25:30.584629 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:30.584606    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-zj7nr" event={"ID":"f8c3a22f-34cb-4baa-b9d8-d568862990f2","Type":"ContainerStarted","Data":"d7d44d800d4ed38e73b62b3d54bbd27e7527f9db0ad4d7b577eec6d6d91fea90"}
Jul 28 20:25:30.586045 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:30.586021    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nhxhl" event={"ID":"a5eaf18c-6121-41c0-8ab2-e98bb06b258f","Type":"ContainerStarted","Data":"9b96d4a94648a97bbeb5e7410ed8f352156fdcf376394228f62abc66cfa261fa"}
Jul 28 20:25:30.587866 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:30.587846    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d8pjr" event={"ID":"2224b59c-8ed4-4bca-8286-9ae7d7227d4b","Type":"ContainerStarted","Data":"7ffd72ebcac755cf354b16f749424ab96627b6dfd497043b53821edf5860879d"}
Jul 28 20:25:30.594074 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:30.593958    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7" podStartSLOduration=18.795201869 podStartE2EDuration="26.59392348s" totalImagesPullingTime="7.798721611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:30.593424654 +0000 UTC m=+44.838801357" watchObservedRunningTime="2026-07-28 20:25:30.59392348 +0000 UTC m=+44.839300183"
Jul 28 20:25:30.634889 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:30.634799    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-zj7nr" podStartSLOduration=20.857423546 podStartE2EDuration="28.634777049s" totalImagesPullingTime="7.777353503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:30.614469947 +0000 UTC m=+44.859846649" watchObservedRunningTime="2026-07-28 20:25:30.634777049 +0000 UTC m=+44.880153752"
Jul 28 20:25:30.655917 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:30.655834    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p" podStartSLOduration=20.892157553 podStartE2EDuration="28.655814517s" totalImagesPullingTime="7.763656964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:30.655330862 +0000 UTC m=+44.900707566" watchObservedRunningTime="2026-07-28 20:25:30.655814517 +0000 UTC m=+44.901191221"
Jul 28 20:25:30.656032 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:30.655956    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d8pjr" podStartSLOduration=2.8757250069999998 podStartE2EDuration="10.655948525s" totalImagesPullingTime="7.780223518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:30.634740319 +0000 UTC m=+44.880117022" watchObservedRunningTime="2026-07-28 20:25:30.655948525 +0000 UTC m=+44.901325226"
Jul 28 20:25:30.671645 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:30.671589    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-tl5xq" podStartSLOduration=17.897522595 podStartE2EDuration="25.671569896s" totalImagesPullingTime="7.774047301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:30.669973111 +0000 UTC m=+44.915349809" watchObservedRunningTime="2026-07-28 20:25:30.671569896 +0000 UTC m=+44.916946577"
Jul 28 20:25:30.686498 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:30.686451    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nhxhl" podStartSLOduration=21.182272165 podStartE2EDuration="28.686431706s" totalImagesPullingTime="7.504159541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:30.68478703 +0000 UTC m=+44.930163731" watchObservedRunningTime="2026-07-28 20:25:30.686431706 +0000 UTC m=+44.931808410"
Jul 28 20:25:31.033611 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.033521    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:31.033611 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.033590    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:31.569050 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.569004    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d56fs"]
Jul 28 20:25:31.591543 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.591483    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d56fs"]
Jul 28 20:25:31.592109 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.591584    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:31.598489 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.594558    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 20:25:31.598489 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.595022    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 20:25:31.598489 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.596489    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-szcgk\""
Jul 28 20:25:31.600296 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.600272    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:25:31.601031 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.601012    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/0.log"
Jul 28 20:25:31.601259 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.601239    2555 generic.go:356] "Generic (PLEG): container finished" podID="d430e74f-09bd-48c4-903c-dba977c7db03" containerID="382de75d3c47349ca0a315cc8d054cd0718b841d38456d1f92dbab134507d9a9" exitCode=255
Jul 28 20:25:31.601747 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.601366    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk" event={"ID":"d430e74f-09bd-48c4-903c-dba977c7db03","Type":"ContainerDied","Data":"382de75d3c47349ca0a315cc8d054cd0718b841d38456d1f92dbab134507d9a9"}
Jul 28 20:25:31.601877 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.601666    2555 scope.go:117] "RemoveContainer" containerID="382de75d3c47349ca0a315cc8d054cd0718b841d38456d1f92dbab134507d9a9"
Jul 28 20:25:31.602066 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:31.602043    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-ndvkk_openshift-console-operator(d430e74f-09bd-48c4-903c-dba977c7db03)\"" pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk" podUID="d430e74f-09bd-48c4-903c-dba977c7db03"
Jul 28 20:25:31.602181 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.602165    2555 scope.go:117] "RemoveContainer" containerID="617d92a9f4ed7b275432199dca143c3c1c1a8d2fbe7777faee1828dc784d57ac"
Jul 28 20:25:31.764746 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.764697    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:31.764947 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.764800    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:31.765013 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.764976    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/16ccfe8d-c942-44d4-84dd-e7d584e2078e-crio-socket\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:31.765085 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.765068    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7fcl\" (UniqueName: \"kubernetes.io/projected/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-api-access-h7fcl\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:31.765230 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.765213    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/16ccfe8d-c942-44d4-84dd-e7d584e2078e-data-volume\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:31.866558 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.866462    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:31.866558 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.866525    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:31.866794 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:31.866621    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 20:25:31.866794 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:31.866655    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 20:25:31.866794 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.866631    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/16ccfe8d-c942-44d4-84dd-e7d584e2078e-crio-socket\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:31.866794 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:31.866700    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls podName:16ccfe8d-c942-44d4-84dd-e7d584e2078e nodeName:}" failed. No retries permitted until 2026-07-28 20:25:32.366679839 +0000 UTC m=+46.612056536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d56fs" (UID: "16ccfe8d-c942-44d4-84dd-e7d584e2078e") : secret "insights-runtime-extractor-tls" not found
Jul 28 20:25:31.866794 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:31.866750    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-rbac-proxy-cm podName:16ccfe8d-c942-44d4-84dd-e7d584e2078e nodeName:}" failed. No retries permitted until 2026-07-28 20:25:32.366730175 +0000 UTC m=+46.612106867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d56fs" (UID: "16ccfe8d-c942-44d4-84dd-e7d584e2078e") : configmap "kube-rbac-proxy" not found
Jul 28 20:25:31.866794 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.866793    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/16ccfe8d-c942-44d4-84dd-e7d584e2078e-crio-socket\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:31.867089 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.866818    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7fcl\" (UniqueName: \"kubernetes.io/projected/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-api-access-h7fcl\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:31.867089 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.866860    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/16ccfe8d-c942-44d4-84dd-e7d584e2078e-data-volume\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:31.867197 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.867178    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/16ccfe8d-c942-44d4-84dd-e7d584e2078e-data-volume\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:31.876736 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.876706    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7fcl\" (UniqueName: \"kubernetes.io/projected/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-api-access-h7fcl\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:31.954116 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.954084    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t"]
Jul 28 20:25:31.986092 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.986058    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t"]
Jul 28 20:25:31.986240 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.986154    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t"
Jul 28 20:25:31.988599 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.988575    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 28 20:25:31.988748 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.988608    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7szqq\""
Jul 28 20:25:31.988748 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:31.988669    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 28 20:25:32.068317 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.068281    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gzb4t\" (UID: \"fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t"
Jul 28 20:25:32.068491 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.068343    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-gzb4t\" (UID: \"fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t"
Jul 28 20:25:32.169077 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.168992    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-gzb4t\" (UID: \"fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t"
Jul 28 20:25:32.169231 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.169147    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gzb4t\" (UID: \"fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t"
Jul 28 20:25:32.169278 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:32.169241    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:25:32.169317 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:32.169290    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert podName:fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:32.669277045 +0000 UTC m=+46.914653727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gzb4t" (UID: "fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a") : secret "networking-console-plugin-cert" not found
Jul 28 20:25:32.169768 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.169747    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-gzb4t\" (UID: \"fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t"
Jul 28 20:25:32.370749 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.370712    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:32.370952 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.370765    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:32.370952 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:32.370889    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 20:25:32.370952 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:32.370906    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 20:25:32.371086 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:32.370981    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls podName:16ccfe8d-c942-44d4-84dd-e7d584e2078e nodeName:}" failed. No retries permitted until 2026-07-28 20:25:33.37096134 +0000 UTC m=+47.616338037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d56fs" (UID: "16ccfe8d-c942-44d4-84dd-e7d584e2078e") : secret "insights-runtime-extractor-tls" not found
Jul 28 20:25:32.371086 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:32.371000    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-rbac-proxy-cm podName:16ccfe8d-c942-44d4-84dd-e7d584e2078e nodeName:}" failed. No retries permitted until 2026-07-28 20:25:33.370991094 +0000 UTC m=+47.616367776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d56fs" (UID: "16ccfe8d-c942-44d4-84dd-e7d584e2078e") : configmap "kube-rbac-proxy" not found
Jul 28 20:25:32.608008 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.607978    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:25:32.608461 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.608369    2555 scope.go:117] "RemoveContainer" containerID="382de75d3c47349ca0a315cc8d054cd0718b841d38456d1f92dbab134507d9a9"
Jul 28 20:25:32.608594 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:32.608569    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-ndvkk_openshift-console-operator(d430e74f-09bd-48c4-903c-dba977c7db03)\"" pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk" podUID="d430e74f-09bd-48c4-903c-dba977c7db03"
Jul 28 20:25:32.673502 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.673460    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gzb4t\" (UID: \"fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t"
Jul 28 20:25:32.673681 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:32.673636    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:25:32.673747 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:32.673712    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert podName:fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:33.673694067 +0000 UTC m=+47.919070750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gzb4t" (UID: "fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a") : secret "networking-console-plugin-cert" not found
Jul 28 20:25:32.704868 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.704829    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-svj26"]
Jul 28 20:25:32.721816 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.721785    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-svj26"
Jul 28 20:25:32.723358 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.723328    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-svj26"]
Jul 28 20:25:32.725519 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.725497    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 28 20:25:32.725624 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.725506    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-snmh8\""
Jul 28 20:25:32.725834 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.725820    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 28 20:25:32.762978 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.762958    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jqxrq_476fb5e0-9429-4e20-b3ab-4ed2f7701c88/dns-node-resolver/0.log"
Jul 28 20:25:32.774384 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.774359    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv4lm\" (UniqueName: \"kubernetes.io/projected/c674ba7d-16bd-4370-a3e2-b7931c3549e8-kube-api-access-kv4lm\") pod \"migrator-6865c9967-svj26\" (UID: \"c674ba7d-16bd-4370-a3e2-b7931c3549e8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-svj26"
Jul 28 20:25:32.874943 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.874856    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv4lm\" (UniqueName: \"kubernetes.io/projected/c674ba7d-16bd-4370-a3e2-b7931c3549e8-kube-api-access-kv4lm\") pod \"migrator-6865c9967-svj26\" (UID: \"c674ba7d-16bd-4370-a3e2-b7931c3549e8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-svj26"
Jul 28 20:25:32.882981 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:32.882955    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv4lm\" (UniqueName: \"kubernetes.io/projected/c674ba7d-16bd-4370-a3e2-b7931c3549e8-kube-api-access-kv4lm\") pod \"migrator-6865c9967-svj26\" (UID: \"c674ba7d-16bd-4370-a3e2-b7931c3549e8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-svj26"
Jul 28 20:25:33.032191 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:33.032152    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-svj26"
Jul 28 20:25:33.174158 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:33.174127    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-svj26"]
Jul 28 20:25:33.177927 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:33.177891    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc674ba7d_16bd_4370_a3e2_b7931c3549e8.slice/crio-71fdc3d2103c7821b195c31cc0885e6ce2cdc4057556bfabfad85257b1de33ed WatchSource:0}: Error finding container 71fdc3d2103c7821b195c31cc0885e6ce2cdc4057556bfabfad85257b1de33ed: Status 404 returned error can't find the container with id 71fdc3d2103c7821b195c31cc0885e6ce2cdc4057556bfabfad85257b1de33ed
Jul 28 20:25:33.379081 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:33.379042    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:33.379250 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:33.379099    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:33.379250 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:33.379173    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 20:25:33.379250 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:33.379247    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-rbac-proxy-cm podName:16ccfe8d-c942-44d4-84dd-e7d584e2078e nodeName:}" failed. No retries permitted until 2026-07-28 20:25:35.379229599 +0000 UTC m=+49.624606291 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d56fs" (UID: "16ccfe8d-c942-44d4-84dd-e7d584e2078e") : configmap "kube-rbac-proxy" not found
Jul 28 20:25:33.379414 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:33.379180    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 20:25:33.379414 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:33.379320    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls podName:16ccfe8d-c942-44d4-84dd-e7d584e2078e nodeName:}" failed. No retries permitted until 2026-07-28 20:25:35.379308511 +0000 UTC m=+49.624685196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d56fs" (UID: "16ccfe8d-c942-44d4-84dd-e7d584e2078e") : secret "insights-runtime-extractor-tls" not found
Jul 28 20:25:33.562981 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:33.562953    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b2hkw_a1cc91af-e639-496c-a81f-84152a29f05c/node-ca/0.log"
Jul 28 20:25:33.612335 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:33.612297    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-svj26" event={"ID":"c674ba7d-16bd-4370-a3e2-b7931c3549e8","Type":"ContainerStarted","Data":"71fdc3d2103c7821b195c31cc0885e6ce2cdc4057556bfabfad85257b1de33ed"}
Jul 28 20:25:33.681452 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:33.681359    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gzb4t\" (UID: \"fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t"
Jul 28 20:25:33.681593 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:33.681504    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:25:33.681593 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:33.681570    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert podName:fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:35.681553726 +0000 UTC m=+49.926930407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gzb4t" (UID: "fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a") : secret "networking-console-plugin-cert" not found
Jul 28 20:25:34.252876 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.252837    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-m7jfj"]
Jul 28 20:25:34.258668 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.258646    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-m7jfj"
Jul 28 20:25:34.263793 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.263759    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 28 20:25:34.264209 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.263963    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-f6vwx\""
Jul 28 20:25:34.264209 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.264077    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 28 20:25:34.264209 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.264147    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 28 20:25:34.265006 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.264746    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 28 20:25:34.280031 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.279989    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-m7jfj"]
Jul 28 20:25:34.286770 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.286734    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0057f567-fbfd-4fc7-a578-953a5154c815-signing-cabundle\") pod \"service-ca-658d7b7c78-m7jfj\" (UID: \"0057f567-fbfd-4fc7-a578-953a5154c815\") " pod="openshift-service-ca/service-ca-658d7b7c78-m7jfj"
Jul 28 20:25:34.286921 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.286843    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxb98\" (UniqueName: \"kubernetes.io/projected/0057f567-fbfd-4fc7-a578-953a5154c815-kube-api-access-cxb98\") pod \"service-ca-658d7b7c78-m7jfj\" (UID: \"0057f567-fbfd-4fc7-a578-953a5154c815\") " pod="openshift-service-ca/service-ca-658d7b7c78-m7jfj"
Jul 28 20:25:34.287089 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.287060    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0057f567-fbfd-4fc7-a578-953a5154c815-signing-key\") pod \"service-ca-658d7b7c78-m7jfj\" (UID: \"0057f567-fbfd-4fc7-a578-953a5154c815\") " pod="openshift-service-ca/service-ca-658d7b7c78-m7jfj"
Jul 28 20:25:34.367664 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.367641    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d8pjr_2224b59c-8ed4-4bca-8286-9ae7d7227d4b/serve-healthcheck-canary/0.log"
Jul 28 20:25:34.387883 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.387859    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0057f567-fbfd-4fc7-a578-953a5154c815-signing-key\") pod \"service-ca-658d7b7c78-m7jfj\" (UID: \"0057f567-fbfd-4fc7-a578-953a5154c815\") " pod="openshift-service-ca/service-ca-658d7b7c78-m7jfj"
Jul 28 20:25:34.388012 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.387920    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0057f567-fbfd-4fc7-a578-953a5154c815-signing-cabundle\") pod \"service-ca-658d7b7c78-m7jfj\" (UID: \"0057f567-fbfd-4fc7-a578-953a5154c815\") " pod="openshift-service-ca/service-ca-658d7b7c78-m7jfj"
Jul 28 20:25:34.388012 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.388004    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxb98\" (UniqueName: \"kubernetes.io/projected/0057f567-fbfd-4fc7-a578-953a5154c815-kube-api-access-cxb98\") pod \"service-ca-658d7b7c78-m7jfj\" (UID: \"0057f567-fbfd-4fc7-a578-953a5154c815\") " pod="openshift-service-ca/service-ca-658d7b7c78-m7jfj"
Jul 28 20:25:34.388610 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.388586    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0057f567-fbfd-4fc7-a578-953a5154c815-signing-cabundle\") pod \"service-ca-658d7b7c78-m7jfj\" (UID: \"0057f567-fbfd-4fc7-a578-953a5154c815\") " pod="openshift-service-ca/service-ca-658d7b7c78-m7jfj"
Jul 28 20:25:34.390122 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.390101    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0057f567-fbfd-4fc7-a578-953a5154c815-signing-key\") pod \"service-ca-658d7b7c78-m7jfj\" (UID: \"0057f567-fbfd-4fc7-a578-953a5154c815\") " pod="openshift-service-ca/service-ca-658d7b7c78-m7jfj"
Jul 28 20:25:34.400815 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.400789    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxb98\" (UniqueName: \"kubernetes.io/projected/0057f567-fbfd-4fc7-a578-953a5154c815-kube-api-access-cxb98\") pod \"service-ca-658d7b7c78-m7jfj\" (UID: \"0057f567-fbfd-4fc7-a578-953a5154c815\") " pod="openshift-service-ca/service-ca-658d7b7c78-m7jfj"
Jul 28 20:25:34.572400 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.572350    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-m7jfj"
Jul 28 20:25:34.617083 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.617050    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-svj26" event={"ID":"c674ba7d-16bd-4370-a3e2-b7931c3549e8","Type":"ContainerStarted","Data":"5e3ee4b5a66b5948854650ecfc1c611862493908e2cff51326ea08d3c2cd44d5"}
Jul 28 20:25:34.617509 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.617109    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-svj26" event={"ID":"c674ba7d-16bd-4370-a3e2-b7931c3549e8","Type":"ContainerStarted","Data":"e66910e2dd563a3fdc4279f8fe613193a361bc5d00ebeed6f3aaefed92fead98"}
Jul 28 20:25:34.635560 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.635509    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-svj26" podStartSLOduration=1.449839133 podStartE2EDuration="2.635494844s" totalImagesPullingTime="1.185655711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:34.63462292 +0000 UTC m=+48.879999623" watchObservedRunningTime="2026-07-28 20:25:34.635494844 +0000 UTC m=+48.880871586"
Jul 28 20:25:34.707164 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:34.707133    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-m7jfj"]
Jul 28 20:25:34.709884 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:34.709857    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0057f567_fbfd_4fc7_a578_953a5154c815.slice/crio-b6f8f093ad866506db9e02a1630c4d4f7bbbeabd9c046da8452f16f802fa488a WatchSource:0}: Error finding container b6f8f093ad866506db9e02a1630c4d4f7bbbeabd9c046da8452f16f802fa488a: Status 404 returned error can't find the container with id b6f8f093ad866506db9e02a1630c4d4f7bbbeabd9c046da8452f16f802fa488a
Jul 28 20:25:35.396517 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:35.396478    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:35.396682 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:35.396526    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:35.396682 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:35.396642    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 20:25:35.396763 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:35.396697    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 20:25:35.396763 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:35.396706    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls podName:16ccfe8d-c942-44d4-84dd-e7d584e2078e nodeName:}" failed. No retries permitted until 2026-07-28 20:25:39.396690069 +0000 UTC m=+53.642066774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d56fs" (UID: "16ccfe8d-c942-44d4-84dd-e7d584e2078e") : secret "insights-runtime-extractor-tls" not found
Jul 28 20:25:35.396837 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:35.396777    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-rbac-proxy-cm podName:16ccfe8d-c942-44d4-84dd-e7d584e2078e nodeName:}" failed. No retries permitted until 2026-07-28 20:25:39.396759407 +0000 UTC m=+53.642136102 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d56fs" (UID: "16ccfe8d-c942-44d4-84dd-e7d584e2078e") : configmap "kube-rbac-proxy" not found
Jul 28 20:25:35.621911 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:35.621861    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-m7jfj" event={"ID":"0057f567-fbfd-4fc7-a578-953a5154c815","Type":"ContainerStarted","Data":"dede2bfefec773f91508a9bf89815e962ec811e66fa90d3b0c183e2ba4b65a7a"}
Jul 28 20:25:35.622390 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:35.621941    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-m7jfj" event={"ID":"0057f567-fbfd-4fc7-a578-953a5154c815","Type":"ContainerStarted","Data":"b6f8f093ad866506db9e02a1630c4d4f7bbbeabd9c046da8452f16f802fa488a"}
Jul 28 20:25:35.644114 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:35.644062    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-m7jfj" podStartSLOduration=1.644044918 podStartE2EDuration="1.644044918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:35.642502796 +0000 UTC m=+49.887879499" watchObservedRunningTime="2026-07-28 20:25:35.644044918 +0000 UTC m=+49.889421620"
Jul 28 20:25:35.699365 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:35.699263    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gzb4t\" (UID: \"fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t"
Jul 28 20:25:35.699540 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:35.699413    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:25:35.699540 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:35.699481    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert podName:fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:39.699465338 +0000 UTC m=+53.944842033 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gzb4t" (UID: "fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a") : secret "networking-console-plugin-cert" not found
Jul 28 20:25:36.506352 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:36.506304    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:36.506551 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:36.506414    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5gg9p\" (UID: \"a8baa7a6-16db-43fb-bac1-928e7df2f3aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p"
Jul 28 20:25:36.506749 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:36.506717    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 20:25:36.506749 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:36.506743    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-95c869d68-xqmpx: secret "image-registry-tls" not found
Jul 28 20:25:36.506952 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:36.506813    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls podName:dbd7039c-be85-49ee-bbab-f211b61ddaab nodeName:}" failed. No retries permitted until 2026-07-28 20:25:52.506789477 +0000 UTC m=+66.752166163 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls") pod "image-registry-95c869d68-xqmpx" (UID: "dbd7039c-be85-49ee-bbab-f211b61ddaab") : secret "image-registry-tls" not found
Jul 28 20:25:36.509478 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:36.509433    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8baa7a6-16db-43fb-bac1-928e7df2f3aa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-5gg9p\" (UID: \"a8baa7a6-16db-43fb-bac1-928e7df2f3aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p"
Jul 28 20:25:36.581516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:36.581480    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p"
Jul 28 20:25:36.607070 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:36.607030    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:36.607197 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:36.607092    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:36.607257 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:36.607221    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle podName:326f8187-7441-426a-b081-130b3e2a0bdb nodeName:}" failed. No retries permitted until 2026-07-28 20:25:52.607201581 +0000 UTC m=+66.852578275 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle") pod "router-default-6f98b6fcdf-f69c6" (UID: "326f8187-7441-426a-b081-130b3e2a0bdb") : configmap references non-existent config key: service-ca.crt
Jul 28 20:25:36.607257 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:36.607224    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 20:25:36.607377 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:36.607295    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls podName:a2663cb4-05c5-4954-8517-3c12845ada7a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:52.607277003 +0000 UTC m=+66.852653694 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls") pod "dns-default-whjpl" (UID: "a2663cb4-05c5-4954-8517-3c12845ada7a") : secret "dns-default-metrics-tls" not found
Jul 28 20:25:36.607441 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:36.607371    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:36.607534 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:36.607513    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-frl28\" (UID: \"064d3b74-ea01-49c6-a3ec-b197a550242b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:36.607653 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:36.607635    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 20:25:36.607713 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:36.607666    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 20:25:36.607713 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:36.607684    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs podName:326f8187-7441-426a-b081-130b3e2a0bdb nodeName:}" failed. No retries permitted until 2026-07-28 20:25:52.607670907 +0000 UTC m=+66.853047600 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs") pod "router-default-6f98b6fcdf-f69c6" (UID: "326f8187-7441-426a-b081-130b3e2a0bdb") : secret "router-metrics-certs-default" not found
Jul 28 20:25:36.607713 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:36.607711    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls podName:064d3b74-ea01-49c6-a3ec-b197a550242b nodeName:}" failed. No retries permitted until 2026-07-28 20:25:52.607698501 +0000 UTC m=+66.853075183 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-frl28" (UID: "064d3b74-ea01-49c6-a3ec-b197a550242b") : secret "cluster-monitoring-operator-tls" not found
Jul 28 20:25:36.740458 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:36.740423    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p"]
Jul 28 20:25:37.633057 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:37.633011    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p" event={"ID":"a8baa7a6-16db-43fb-bac1-928e7df2f3aa","Type":"ContainerStarted","Data":"34c3a0ae68669f2e7509190db4bbdf06a241ba45c4b6683ca555548e38ce0181"}
Jul 28 20:25:38.638322 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:38.638293    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p" event={"ID":"a8baa7a6-16db-43fb-bac1-928e7df2f3aa","Type":"ContainerStarted","Data":"3744bd6eec6ae2e1041cbd90f34bc108c3cecf748f01d95b0226065df7bcfb0b"}
Jul 28 20:25:39.432792 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:39.432741    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:39.433037 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:39.432803    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:39.433037 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:39.432908    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 20:25:39.433037 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:39.433005    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls podName:16ccfe8d-c942-44d4-84dd-e7d584e2078e nodeName:}" failed. No retries permitted until 2026-07-28 20:25:47.432987379 +0000 UTC m=+61.678364075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d56fs" (UID: "16ccfe8d-c942-44d4-84dd-e7d584e2078e") : secret "insights-runtime-extractor-tls" not found
Jul 28 20:25:39.433390 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:39.433368    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/16ccfe8d-c942-44d4-84dd-e7d584e2078e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:39.642871 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:39.642834    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p" event={"ID":"a8baa7a6-16db-43fb-bac1-928e7df2f3aa","Type":"ContainerStarted","Data":"e66c4b7667e8bffbace6fbc940a48e7f4171d5e9127e51d6a976e586dba0e2e8"}
Jul 28 20:25:39.661490 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:39.661435    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-5gg9p" podStartSLOduration=35.889993075 podStartE2EDuration="37.661417562s" totalImagesPullingTime="1.771424487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:39.659822075 +0000 UTC m=+53.905198780" watchObservedRunningTime="2026-07-28 20:25:39.661417562 +0000 UTC m=+53.906794264"
Jul 28 20:25:39.735630 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:39.735535    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gzb4t\" (UID: \"fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t"
Jul 28 20:25:39.735788 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:39.735645    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 20:25:39.735788 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:25:39.735717    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert podName:fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:47.735697984 +0000 UTC m=+61.981074681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-gzb4t" (UID: "fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a") : secret "networking-console-plugin-cert" not found
Jul 28 20:25:41.033393 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:41.033345    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:41.033851 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:41.033424    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:41.033851 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:41.033815    2555 scope.go:117] "RemoveContainer" containerID="382de75d3c47349ca0a315cc8d054cd0718b841d38456d1f92dbab134507d9a9"
Jul 28 20:25:41.650736 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:41.650707    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:25:41.650909 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:41.650836    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk" event={"ID":"d430e74f-09bd-48c4-903c-dba977c7db03","Type":"ContainerStarted","Data":"57f71649f6e596c723730611ae02318b7293a9756c806d45e08d32cf812a9b14"}
Jul 28 20:25:41.651211 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:41.651190    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:41.679426 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:41.679373    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk" podStartSLOduration=31.903823762000002 podStartE2EDuration="39.679358719s" totalImagesPullingTime="7.775534957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:41.678405318 +0000 UTC m=+55.923782037" watchObservedRunningTime="2026-07-28 20:25:41.679358719 +0000 UTC m=+55.924735420"
Jul 28 20:25:42.070750 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:42.070722    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-ndvkk"
Jul 28 20:25:47.505420 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:47.505378    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:47.507687 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:47.507657    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/16ccfe8d-c942-44d4-84dd-e7d584e2078e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d56fs\" (UID: \"16ccfe8d-c942-44d4-84dd-e7d584e2078e\") " pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:47.510258 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:47.510234    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-szcgk\""
Jul 28 20:25:47.511597 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:47.511578    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5p8q6"
Jul 28 20:25:47.518385 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:47.518362    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d56fs"
Jul 28 20:25:47.648452 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:47.648419    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d56fs"]
Jul 28 20:25:47.651615 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:47.651589    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ccfe8d_c942_44d4_84dd_e7d584e2078e.slice/crio-8655bf44eda5f1f8985b29e083bc2052c180874988d5a7b36ca12740e333cf4c WatchSource:0}: Error finding container 8655bf44eda5f1f8985b29e083bc2052c180874988d5a7b36ca12740e333cf4c: Status 404 returned error can't find the container with id 8655bf44eda5f1f8985b29e083bc2052c180874988d5a7b36ca12740e333cf4c
Jul 28 20:25:47.670666 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:47.670631    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d56fs" event={"ID":"16ccfe8d-c942-44d4-84dd-e7d584e2078e","Type":"ContainerStarted","Data":"8655bf44eda5f1f8985b29e083bc2052c180874988d5a7b36ca12740e333cf4c"}
Jul 28 20:25:47.808702 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:47.808608    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gzb4t\" (UID: \"fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t"
Jul 28 20:25:47.811042 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:47.811015    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-gzb4t\" (UID: \"fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t"
Jul 28 20:25:47.897942 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:47.897904    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7szqq\""
Jul 28 20:25:47.906150 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:47.906120    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t"
Jul 28 20:25:48.035372 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:48.035272    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t"]
Jul 28 20:25:48.037738 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:48.037707    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc9d3dee_24c2_43a6_ae84_6af8aae2cf8a.slice/crio-9c5ab8c3fdeee079dda2c76c3cfefbbeba6f2d2b9244954af6c5b9a59f34dd71 WatchSource:0}: Error finding container 9c5ab8c3fdeee079dda2c76c3cfefbbeba6f2d2b9244954af6c5b9a59f34dd71: Status 404 returned error can't find the container with id 9c5ab8c3fdeee079dda2c76c3cfefbbeba6f2d2b9244954af6c5b9a59f34dd71
Jul 28 20:25:48.679014 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:48.678968    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t" event={"ID":"fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a","Type":"ContainerStarted","Data":"9c5ab8c3fdeee079dda2c76c3cfefbbeba6f2d2b9244954af6c5b9a59f34dd71"}
Jul 28 20:25:49.684331 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:49.684242    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t" event={"ID":"fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a","Type":"ContainerStarted","Data":"f118676392d6738794720d68ad988dad4c6f91f3a3d23afa3b7d7be1b2c34150"}
Jul 28 20:25:49.700604 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:49.700542    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-gzb4t" podStartSLOduration=17.372314978 podStartE2EDuration="18.700519648s" totalImagesPullingTime="1.32820467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:49.69978482 +0000 UTC m=+63.945161523" watchObservedRunningTime="2026-07-28 20:25:49.700519648 +0000 UTC m=+63.945896350"
Jul 28 20:25:51.950765 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:51.950723    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljgtq\" (UniqueName: \"kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq\") pod \"network-check-target-dnptj\" (UID: \"8ef7b402-f97f-4996-b603-76ae46459289\") " pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:51.953426 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:51.953394    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljgtq\" (UniqueName: \"kubernetes.io/projected/8ef7b402-f97f-4996-b603-76ae46459289-kube-api-access-ljgtq\") pod \"network-check-target-dnptj\" (UID: \"8ef7b402-f97f-4996-b603-76ae46459289\") " pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:52.021244 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.021210    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9c5p9\""
Jul 28 20:25:52.029366 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.029341    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:52.051515 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.051480    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret\") pod \"global-pull-secret-syncer-vm6v9\" (UID: \"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34\") " pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:52.051515 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.051518    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs\") pod \"network-metrics-daemon-kwz5g\" (UID: \"d6feb623-4784-4351-88a5-ed677f7c0ffb\") " pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:52.054141 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.054121    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 20:25:52.054251 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.054140    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 20:25:52.064803 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.064760    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a04cb7b-6d7a-4c0b-a854-d12e6195bd34-original-pull-secret\") pod \"global-pull-secret-syncer-vm6v9\" (UID: \"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34\") " pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:52.064960 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.064783    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6feb623-4784-4351-88a5-ed677f7c0ffb-metrics-certs\") pod \"network-metrics-daemon-kwz5g\" (UID: \"d6feb623-4784-4351-88a5-ed677f7c0ffb\") " pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:52.310166 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.310139    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sn8zg\""
Jul 28 20:25:52.318584 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.318558    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kwz5g"
Jul 28 20:25:52.328840 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.328817    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vm6v9"
Jul 28 20:25:52.554702 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.554662    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:52.557269 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.557244    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls\") pod \"image-registry-95c869d68-xqmpx\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") " pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:52.655963 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.655857    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-frl28\" (UID: \"064d3b74-ea01-49c6-a3ec-b197a550242b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:52.656118 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.655966    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:52.656118 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.656018    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:52.656118 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.656067    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:52.656997 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.656897    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326f8187-7441-426a-b081-130b3e2a0bdb-service-ca-bundle\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:52.658613 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.658589    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/064d3b74-ea01-49c6-a3ec-b197a550242b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-frl28\" (UID: \"064d3b74-ea01-49c6-a3ec-b197a550242b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:52.658745 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.658600    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2663cb4-05c5-4954-8517-3c12845ada7a-metrics-tls\") pod \"dns-default-whjpl\" (UID: \"a2663cb4-05c5-4954-8517-3c12845ada7a\") " pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:52.658972 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.658947    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326f8187-7441-426a-b081-130b3e2a0bdb-metrics-certs\") pod \"router-default-6f98b6fcdf-f69c6\" (UID: \"326f8187-7441-426a-b081-130b3e2a0bdb\") " pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:52.770989 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.770956    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-59v79\""
Jul 28 20:25:52.774871 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.774848    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:52.817767 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.817738    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-65s44\""
Jul 28 20:25:52.825798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.825778    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"
Jul 28 20:25:52.861594 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.861566    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f7z9m\""
Jul 28 20:25:52.868508 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.868479    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:52.878305 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.878280    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8kqlj\""
Jul 28 20:25:52.883042 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:52.883019    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whjpl"
Jul 28 20:25:53.448355 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.448271    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vm6v9"]
Jul 28 20:25:53.453044 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:53.453022    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a04cb7b_6d7a_4c0b_a854_d12e6195bd34.slice/crio-f27c70059b74624b7e7e9d5c2079304bda092ac6cdbf5715929db1432034d31a WatchSource:0}: Error finding container f27c70059b74624b7e7e9d5c2079304bda092ac6cdbf5715929db1432034d31a: Status 404 returned error can't find the container with id f27c70059b74624b7e7e9d5c2079304bda092ac6cdbf5715929db1432034d31a
Jul 28 20:25:53.513277 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.513250    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-95c869d68-xqmpx"]
Jul 28 20:25:53.517173 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:53.517146    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbd7039c_be85_49ee_bbab_f211b61ddaab.slice/crio-5f245ca5686dfdf03992a1349bb4d4992ac6d555691a7e45bb8a0467081f2bd4 WatchSource:0}: Error finding container 5f245ca5686dfdf03992a1349bb4d4992ac6d555691a7e45bb8a0467081f2bd4: Status 404 returned error can't find the container with id 5f245ca5686dfdf03992a1349bb4d4992ac6d555691a7e45bb8a0467081f2bd4
Jul 28 20:25:53.653343 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.653303    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-549cb46c4-7n5mf"]
Jul 28 20:25:53.656955 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.656916    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-549cb46c4-7n5mf"
Jul 28 20:25:53.659169 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.659152    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 20:25:53.659619 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.659602    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 20:25:53.659809 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.659786    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-twgkj\""
Jul 28 20:25:53.659894 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.659880    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 28 20:25:53.660026 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.659989    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 20:25:53.674700 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.674667    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kwz5g"]
Jul 28 20:25:53.676161 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.676139    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"]
Jul 28 20:25:53.681305 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.681280    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m"]
Jul 28 20:25:53.683190 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.682676    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.689737 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.689710    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-549cb46c4-7n5mf"]
Jul 28 20:25:53.689840 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.689819    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m"
Jul 28 20:25:53.699718 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.699670    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vm6v9" event={"ID":"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34","Type":"ContainerStarted","Data":"f27c70059b74624b7e7e9d5c2079304bda092ac6cdbf5715929db1432034d31a"}
Jul 28 20:25:53.701124 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.701096    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kwz5g" event={"ID":"d6feb623-4784-4351-88a5-ed677f7c0ffb","Type":"ContainerStarted","Data":"eb5e8c6ab423d2d1c69ed58b55bca03841b752d31c66990a14244cbe7968657b"}
Jul 28 20:25:53.704389 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.704362    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d56fs" event={"ID":"16ccfe8d-c942-44d4-84dd-e7d584e2078e","Type":"ContainerStarted","Data":"c762e081d21ff34c1f56736ec7f3cff37ee420d03d798e4999f282bfbac16248"}
Jul 28 20:25:53.707790 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.707598    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-95c869d68-xqmpx" event={"ID":"dbd7039c-be85-49ee-bbab-f211b61ddaab","Type":"ContainerStarted","Data":"66f95f6932e3c74844195d7c71ea12d8d812c660818fbf6ea35cb2bc4824443a"}
Jul 28 20:25:53.707790 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.707652    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-95c869d68-xqmpx" event={"ID":"dbd7039c-be85-49ee-bbab-f211b61ddaab","Type":"ContainerStarted","Data":"5f245ca5686dfdf03992a1349bb4d4992ac6d555691a7e45bb8a0467081f2bd4"}
Jul 28 20:25:53.707982 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.707964    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:25:53.718139 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.718112    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 28 20:25:53.719340 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.719312    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"]
Jul 28 20:25:53.728533 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:53.728504    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef7b402_f97f_4996_b603_76ae46459289.slice/crio-90537256830e35cb8c8f1b0a08abdc08a826b94129644f7cda7bf5752019be13 WatchSource:0}: Error finding container 90537256830e35cb8c8f1b0a08abdc08a826b94129644f7cda7bf5752019be13: Status 404 returned error can't find the container with id 90537256830e35cb8c8f1b0a08abdc08a826b94129644f7cda7bf5752019be13
Jul 28 20:25:53.732685 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.732658    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 28 20:25:53.732685 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.732679    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 28 20:25:53.732916 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.732895    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 28 20:25:53.733029 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.732960    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 28 20:25:53.734609 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.734587    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dnptj"]
Jul 28 20:25:53.735471 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.735450    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m"]
Jul 28 20:25:53.765761 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.765732    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6bf0e333-fde7-4011-bf24-1c31d199206d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.765955 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.765835    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bf0e333-fde7-4011-bf24-1c31d199206d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.765955 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.765884    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601-klusterlet-config\") pod \"klusterlet-addon-workmgr-6696674cd4-msw5m\" (UID: \"ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m"
Jul 28 20:25:53.766075 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.765994    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d0f0826-7aa7-4274-8e12-2d9711d34443-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-549cb46c4-7n5mf\" (UID: \"0d0f0826-7aa7-4274-8e12-2d9711d34443\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-549cb46c4-7n5mf"
Jul 28 20:25:53.766075 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.766021    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t577l\" (UniqueName: \"kubernetes.io/projected/ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601-kube-api-access-t577l\") pod \"klusterlet-addon-workmgr-6696674cd4-msw5m\" (UID: \"ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m"
Jul 28 20:25:53.766075 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.766048    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6bf0e333-fde7-4011-bf24-1c31d199206d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.766075 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.766072    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601-tmp\") pod \"klusterlet-addon-workmgr-6696674cd4-msw5m\" (UID: \"ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m"
Jul 28 20:25:53.766275 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.766141    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6bf0e333-fde7-4011-bf24-1c31d199206d-ca\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.766275 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.766193    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfr6m\" (UniqueName: \"kubernetes.io/projected/0d0f0826-7aa7-4274-8e12-2d9711d34443-kube-api-access-rfr6m\") pod \"managed-serviceaccount-addon-agent-549cb46c4-7n5mf\" (UID: \"0d0f0826-7aa7-4274-8e12-2d9711d34443\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-549cb46c4-7n5mf"
Jul 28 20:25:53.766275 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.766215    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6bf0e333-fde7-4011-bf24-1c31d199206d-hub\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.766275 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.766239    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx9rd\" (UniqueName: \"kubernetes.io/projected/6bf0e333-fde7-4011-bf24-1c31d199206d-kube-api-access-lx9rd\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.776142 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.776110    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-whjpl"]
Jul 28 20:25:53.777655 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.777631    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f98b6fcdf-f69c6"]
Jul 28 20:25:53.778514 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.778496    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28"]
Jul 28 20:25:53.786033 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:53.785875    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2663cb4_05c5_4954_8517_3c12845ada7a.slice/crio-0d99b287c62ef1c4025524217c6281da6ac02be6d50597c5e530fcfc993a7667 WatchSource:0}: Error finding container 0d99b287c62ef1c4025524217c6281da6ac02be6d50597c5e530fcfc993a7667: Status 404 returned error can't find the container with id 0d99b287c62ef1c4025524217c6281da6ac02be6d50597c5e530fcfc993a7667
Jul 28 20:25:53.786728 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:53.786685    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod064d3b74_ea01_49c6_a3ec_b197a550242b.slice/crio-c894c1df7472f5d66fbd22bd2ee951e912bfd949845ebee97bc89c9119c4301f WatchSource:0}: Error finding container c894c1df7472f5d66fbd22bd2ee951e912bfd949845ebee97bc89c9119c4301f: Status 404 returned error can't find the container with id c894c1df7472f5d66fbd22bd2ee951e912bfd949845ebee97bc89c9119c4301f
Jul 28 20:25:53.788551 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:53.788317    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod326f8187_7441_426a_b081_130b3e2a0bdb.slice/crio-525740feebcfa993f3aee165796b8ae196eaafa84f1cfc92e7dcca2aa5672df3 WatchSource:0}: Error finding container 525740feebcfa993f3aee165796b8ae196eaafa84f1cfc92e7dcca2aa5672df3: Status 404 returned error can't find the container with id 525740feebcfa993f3aee165796b8ae196eaafa84f1cfc92e7dcca2aa5672df3
Jul 28 20:25:53.865098 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.865035    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-95c869d68-xqmpx" podStartSLOduration=66.865012091 podStartE2EDuration="1m6.865012091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:24:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:53.863811602 +0000 UTC m=+68.109188306" watchObservedRunningTime="2026-07-28 20:25:53.865012091 +0000 UTC m=+68.110388796"
Jul 28 20:25:53.867213 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.867179    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfr6m\" (UniqueName: \"kubernetes.io/projected/0d0f0826-7aa7-4274-8e12-2d9711d34443-kube-api-access-rfr6m\") pod \"managed-serviceaccount-addon-agent-549cb46c4-7n5mf\" (UID: \"0d0f0826-7aa7-4274-8e12-2d9711d34443\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-549cb46c4-7n5mf"
Jul 28 20:25:53.867373 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.867228    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6bf0e333-fde7-4011-bf24-1c31d199206d-hub\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.867373 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.867257    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx9rd\" (UniqueName: \"kubernetes.io/projected/6bf0e333-fde7-4011-bf24-1c31d199206d-kube-api-access-lx9rd\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.867495 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.867374    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6bf0e333-fde7-4011-bf24-1c31d199206d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.867495 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.867418    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bf0e333-fde7-4011-bf24-1c31d199206d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.867495 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.867454    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601-klusterlet-config\") pod \"klusterlet-addon-workmgr-6696674cd4-msw5m\" (UID: \"ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m"
Jul 28 20:25:53.867651 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.867509    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d0f0826-7aa7-4274-8e12-2d9711d34443-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-549cb46c4-7n5mf\" (UID: \"0d0f0826-7aa7-4274-8e12-2d9711d34443\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-549cb46c4-7n5mf"
Jul 28 20:25:53.867651 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.867537    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t577l\" (UniqueName: \"kubernetes.io/projected/ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601-kube-api-access-t577l\") pod \"klusterlet-addon-workmgr-6696674cd4-msw5m\" (UID: \"ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m"
Jul 28 20:25:53.867651 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.867563    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6bf0e333-fde7-4011-bf24-1c31d199206d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.867651 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.867586    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601-tmp\") pod \"klusterlet-addon-workmgr-6696674cd4-msw5m\" (UID: \"ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m"
Jul 28 20:25:53.867651 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.867631    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6bf0e333-fde7-4011-bf24-1c31d199206d-ca\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.868835 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.868788    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601-tmp\") pod \"klusterlet-addon-workmgr-6696674cd4-msw5m\" (UID: \"ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m"
Jul 28 20:25:53.868835 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.868803    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bf0e333-fde7-4011-bf24-1c31d199206d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.870850 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.870825    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d0f0826-7aa7-4274-8e12-2d9711d34443-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-549cb46c4-7n5mf\" (UID: \"0d0f0826-7aa7-4274-8e12-2d9711d34443\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-549cb46c4-7n5mf"
Jul 28 20:25:53.871123 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.871099    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6bf0e333-fde7-4011-bf24-1c31d199206d-ca\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.871220 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.871172    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6bf0e333-fde7-4011-bf24-1c31d199206d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.871288 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.871245    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6bf0e333-fde7-4011-bf24-1c31d199206d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.871466 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.871441    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6bf0e333-fde7-4011-bf24-1c31d199206d-hub\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.871620 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.871600    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601-klusterlet-config\") pod \"klusterlet-addon-workmgr-6696674cd4-msw5m\" (UID: \"ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m"
Jul 28 20:25:53.908004 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.907973    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfr6m\" (UniqueName: \"kubernetes.io/projected/0d0f0826-7aa7-4274-8e12-2d9711d34443-kube-api-access-rfr6m\") pod \"managed-serviceaccount-addon-agent-549cb46c4-7n5mf\" (UID: \"0d0f0826-7aa7-4274-8e12-2d9711d34443\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-549cb46c4-7n5mf"
Jul 28 20:25:53.910555 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.910532    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t577l\" (UniqueName: \"kubernetes.io/projected/ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601-kube-api-access-t577l\") pod \"klusterlet-addon-workmgr-6696674cd4-msw5m\" (UID: \"ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m"
Jul 28 20:25:53.924208 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.924179    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-fnswx"]
Jul 28 20:25:53.925537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.925517    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx9rd\" (UniqueName: \"kubernetes.io/projected/6bf0e333-fde7-4011-bf24-1c31d199206d-kube-api-access-lx9rd\") pod \"cluster-proxy-proxy-agent-7f6b4564f-62m9r\" (UID: \"6bf0e333-fde7-4011-bf24-1c31d199206d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:53.928991 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.928974    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-fnswx"
Jul 28 20:25:53.939126 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.939091    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 20:25:53.939287 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.939194    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-d5rzn\""
Jul 28 20:25:53.945086 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.945063    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 20:25:53.980082 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.980040    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-549cb46c4-7n5mf"
Jul 28 20:25:53.997762 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:53.997555    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"
Jul 28 20:25:54.005697 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.005664    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m"
Jul 28 20:25:54.047523 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.047435    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-fnswx"]
Jul 28 20:25:54.074521 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.071850    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5hnf\" (UniqueName: \"kubernetes.io/projected/fa4518af-977d-4c93-94a3-711eb64f3dc1-kube-api-access-r5hnf\") pod \"downloads-7c97dc4555-fnswx\" (UID: \"fa4518af-977d-4c93-94a3-711eb64f3dc1\") " pod="openshift-console/downloads-7c97dc4555-fnswx"
Jul 28 20:25:54.173395 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.173359    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5hnf\" (UniqueName: \"kubernetes.io/projected/fa4518af-977d-4c93-94a3-711eb64f3dc1-kube-api-access-r5hnf\") pod \"downloads-7c97dc4555-fnswx\" (UID: \"fa4518af-977d-4c93-94a3-711eb64f3dc1\") " pod="openshift-console/downloads-7c97dc4555-fnswx"
Jul 28 20:25:54.199508 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.199418    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5hnf\" (UniqueName: \"kubernetes.io/projected/fa4518af-977d-4c93-94a3-711eb64f3dc1-kube-api-access-r5hnf\") pod \"downloads-7c97dc4555-fnswx\" (UID: \"fa4518af-977d-4c93-94a3-711eb64f3dc1\") " pod="openshift-console/downloads-7c97dc4555-fnswx"
Jul 28 20:25:54.223584 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.223513    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-549cb46c4-7n5mf"]
Jul 28 20:25:54.236488 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:54.236408    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d0f0826_7aa7_4274_8e12_2d9711d34443.slice/crio-d74dead72d02f73389cef536d1cec370a032c6d8f5fdabc391040be873019ee0 WatchSource:0}: Error finding container d74dead72d02f73389cef536d1cec370a032c6d8f5fdabc391040be873019ee0: Status 404 returned error can't find the container with id d74dead72d02f73389cef536d1cec370a032c6d8f5fdabc391040be873019ee0
Jul 28 20:25:54.252322 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.252038    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-fnswx"
Jul 28 20:25:54.276925 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.276848    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m"]
Jul 28 20:25:54.282118 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:54.282077    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae82d6ba_b66c_46b7_bf4c_dfb38a2d2601.slice/crio-a57cc02f345edb7628e1359dc0bc9326a7199b55b9f1fd44e2b0777c29e8b983 WatchSource:0}: Error finding container a57cc02f345edb7628e1359dc0bc9326a7199b55b9f1fd44e2b0777c29e8b983: Status 404 returned error can't find the container with id a57cc02f345edb7628e1359dc0bc9326a7199b55b9f1fd44e2b0777c29e8b983
Jul 28 20:25:54.299378 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.299307    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r"]
Jul 28 20:25:54.303731 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:54.303694    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bf0e333_fde7_4011_bf24_1c31d199206d.slice/crio-539ca51a1a5e49420054f1de7fcd517468269bf7469b12ad1b3ea68e38f0442c WatchSource:0}: Error finding container 539ca51a1a5e49420054f1de7fcd517468269bf7469b12ad1b3ea68e38f0442c: Status 404 returned error can't find the container with id 539ca51a1a5e49420054f1de7fcd517468269bf7469b12ad1b3ea68e38f0442c
Jul 28 20:25:54.463272 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.463216    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-fnswx"]
Jul 28 20:25:54.468826 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:25:54.468793    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4518af_977d_4c93_94a3_711eb64f3dc1.slice/crio-5aa16bf79e12849b820c8942785c3e810b29418e6f4a74f8b22b2d9f1ed3f4b9 WatchSource:0}: Error finding container 5aa16bf79e12849b820c8942785c3e810b29418e6f4a74f8b22b2d9f1ed3f4b9: Status 404 returned error can't find the container with id 5aa16bf79e12849b820c8942785c3e810b29418e6f4a74f8b22b2d9f1ed3f4b9
Jul 28 20:25:54.727976 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.727866    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r" event={"ID":"6bf0e333-fde7-4011-bf24-1c31d199206d","Type":"ContainerStarted","Data":"539ca51a1a5e49420054f1de7fcd517468269bf7469b12ad1b3ea68e38f0442c"}
Jul 28 20:25:54.732483 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.731847    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m" event={"ID":"ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601","Type":"ContainerStarted","Data":"a57cc02f345edb7628e1359dc0bc9326a7199b55b9f1fd44e2b0777c29e8b983"}
Jul 28 20:25:54.735789 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.735758    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-549cb46c4-7n5mf" event={"ID":"0d0f0826-7aa7-4274-8e12-2d9711d34443","Type":"ContainerStarted","Data":"d74dead72d02f73389cef536d1cec370a032c6d8f5fdabc391040be873019ee0"}
Jul 28 20:25:54.744070 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.744017    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f98b6fcdf-f69c6" event={"ID":"326f8187-7441-426a-b081-130b3e2a0bdb","Type":"ContainerStarted","Data":"e81d19bef015e8d5b1595a38bf86a010020bd854de50708d90fa6f82039a37f2"}
Jul 28 20:25:54.744215 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.744077    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f98b6fcdf-f69c6" event={"ID":"326f8187-7441-426a-b081-130b3e2a0bdb","Type":"ContainerStarted","Data":"525740feebcfa993f3aee165796b8ae196eaafa84f1cfc92e7dcca2aa5672df3"}
Jul 28 20:25:54.752950 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.752847    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whjpl" event={"ID":"a2663cb4-05c5-4954-8517-3c12845ada7a","Type":"ContainerStarted","Data":"0d99b287c62ef1c4025524217c6281da6ac02be6d50597c5e530fcfc993a7667"}
Jul 28 20:25:54.755905 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.755793    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-fnswx" event={"ID":"fa4518af-977d-4c93-94a3-711eb64f3dc1","Type":"ContainerStarted","Data":"5aa16bf79e12849b820c8942785c3e810b29418e6f4a74f8b22b2d9f1ed3f4b9"}
Jul 28 20:25:54.758675 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.758603    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28" event={"ID":"064d3b74-ea01-49c6-a3ec-b197a550242b","Type":"ContainerStarted","Data":"c894c1df7472f5d66fbd22bd2ee951e912bfd949845ebee97bc89c9119c4301f"}
Jul 28 20:25:54.763261 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.763045    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dnptj" event={"ID":"8ef7b402-f97f-4996-b603-76ae46459289","Type":"ContainerStarted","Data":"a7190ceb359178b6de5952a2baaaf17783f92039e3270b0cc0cdc4d115d70157"}
Jul 28 20:25:54.763261 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.763091    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:25:54.763261 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.763112    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dnptj" event={"ID":"8ef7b402-f97f-4996-b603-76ae46459289","Type":"ContainerStarted","Data":"90537256830e35cb8c8f1b0a08abdc08a826b94129644f7cda7bf5752019be13"}
Jul 28 20:25:54.811337 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.810797    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f98b6fcdf-f69c6" podStartSLOduration=52.810772722 podStartE2EDuration="52.810772722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:54.807765992 +0000 UTC m=+69.053142695" watchObservedRunningTime="2026-07-28 20:25:54.810772722 +0000 UTC m=+69.056149429"
Jul 28 20:25:54.838702 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.838628    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dnptj" podStartSLOduration=67.838603462 podStartE2EDuration="1m7.838603462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:24:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:54.837310276 +0000 UTC m=+69.082686990" watchObservedRunningTime="2026-07-28 20:25:54.838603462 +0000 UTC m=+69.083980160"
Jul 28 20:25:54.869995 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.869666    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:54.872956 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:54.872912    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:55.779793 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:55.778989    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kwz5g" event={"ID":"d6feb623-4784-4351-88a5-ed677f7c0ffb","Type":"ContainerStarted","Data":"9a8eccc4c6db73f18495101930c0cabe3a5416603ffbf5f21ee0afb47119e5db"}
Jul 28 20:25:55.779793 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:55.779048    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kwz5g" event={"ID":"d6feb623-4784-4351-88a5-ed677f7c0ffb","Type":"ContainerStarted","Data":"625b86beada9e609f1bcfd1316f11e2266e9710dc26318df10b458af1d63975f"}
Jul 28 20:25:55.779793 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:55.779079    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:55.779793 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:55.779692    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f98b6fcdf-f69c6"
Jul 28 20:25:55.797866 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:25:55.797054    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kwz5g" podStartSLOduration=67.143559053 podStartE2EDuration="1m8.797030516s" totalImagesPullingTime="1.653471463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:55.795148176 +0000 UTC m=+70.040524879" watchObservedRunningTime="2026-07-28 20:25:55.797030516 +0000 UTC m=+70.042407219"
Jul 28 20:26:08.854145 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.853600    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whjpl" event={"ID":"a2663cb4-05c5-4954-8517-3c12845ada7a","Type":"ContainerStarted","Data":"ddd9da99c4a81edec0cafb3cf9679d54b529a5846962d1f9eddfd48da5e713f6"}
Jul 28 20:26:08.854145 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.853711    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whjpl" event={"ID":"a2663cb4-05c5-4954-8517-3c12845ada7a","Type":"ContainerStarted","Data":"1c6e2046142a90e57cb1b716f41c71b7dabd94e660c887ee34657e5761e57551"}
Jul 28 20:26:08.854145 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.853747    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-whjpl"
Jul 28 20:26:08.855631 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.855582    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28" event={"ID":"064d3b74-ea01-49c6-a3ec-b197a550242b","Type":"ContainerStarted","Data":"a68b9eb692ad74b8e485c63697f44d3033c846db0d6963b53a1f93bbd6747599"}
Jul 28 20:26:08.857333 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.857277    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vm6v9" event={"ID":"4a04cb7b-6d7a-4c0b-a854-d12e6195bd34","Type":"ContainerStarted","Data":"d0649635981566cac904ea9fff2cc478438a768620e5aeb86e6714708db93b04"}
Jul 28 20:26:08.863852 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.863575    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r" event={"ID":"6bf0e333-fde7-4011-bf24-1c31d199206d","Type":"ContainerStarted","Data":"a1acb4dfe03293f6f20feb3a373138074e8f0d927c55e3bf0f057e5798b13a75"}
Jul 28 20:26:08.863852 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.863621    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r" event={"ID":"6bf0e333-fde7-4011-bf24-1c31d199206d","Type":"ContainerStarted","Data":"f957db294e2c280d8d92a33892b48800686f26b5b5a2e43b077f56b4da97b8aa"}
Jul 28 20:26:08.863852 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.863643    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r" event={"ID":"6bf0e333-fde7-4011-bf24-1c31d199206d","Type":"ContainerStarted","Data":"d3793d61df6e919b2e627589eb455b1b0f11bd8b7faba1f27f3e2435db7fbb73"}
Jul 28 20:26:08.866965 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.866166    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d56fs" event={"ID":"16ccfe8d-c942-44d4-84dd-e7d584e2078e","Type":"ContainerStarted","Data":"c58f9e24f9f6b549d89999b66f1e9f8fa9419d69df445d5dcaafb7ae3b25a106"}
Jul 28 20:26:08.870231 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.870198    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m" event={"ID":"ae82d6ba-b66c-46b7-bf4c-dfb38a2d2601","Type":"ContainerStarted","Data":"aaa2490e3399c34d16a9a8a4a73de0f5980ef58b6a03843df8a870bdfc9b4576"}
Jul 28 20:26:08.870583 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.870420    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m"
Jul 28 20:26:08.872399 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.872380    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m"
Jul 28 20:26:08.873547 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.873127    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-549cb46c4-7n5mf" event={"ID":"0d0f0826-7aa7-4274-8e12-2d9711d34443","Type":"ContainerStarted","Data":"077860c72411f2b42d56f2665972c71918da7bdf88e41d29daaced51536a9a5e"}
Jul 28 20:26:08.889970 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.889875    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-whjpl" podStartSLOduration=35.173428539 podStartE2EDuration="48.889855541s" totalImagesPullingTime="13.716427002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:08.889551368 +0000 UTC m=+83.134928065" watchObservedRunningTime="2026-07-28 20:26:08.889855541 +0000 UTC m=+83.135232245"
Jul 28 20:26:08.922563 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.922437    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f6b4564f-62m9r" podStartSLOduration=1.954602156 podStartE2EDuration="15.922415714s" totalImagesPullingTime="13.967813558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:08.919807238 +0000 UTC m=+83.165183941" watchObservedRunningTime="2026-07-28 20:26:08.922415714 +0000 UTC m=+83.167792408"
Jul 28 20:26:08.951478 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.951413    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-549cb46c4-7n5mf" podStartSLOduration=1.918442319 podStartE2EDuration="15.951393349s" totalImagesPullingTime="14.03295103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:08.949398495 +0000 UTC m=+83.194775203" watchObservedRunningTime="2026-07-28 20:26:08.951393349 +0000 UTC m=+83.196770051"
Jul 28 20:26:08.973450 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.973383    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6696674cd4-msw5m" podStartSLOduration=1.936395434 podStartE2EDuration="15.973362364s" totalImagesPullingTime="14.03696693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:08.970801498 +0000 UTC m=+83.216178202" watchObservedRunningTime="2026-07-28 20:26:08.973362364 +0000 UTC m=+83.218739068"
Jul 28 20:26:08.999791 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:08.999080    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vm6v9" podStartSLOduration=67.178798544 podStartE2EDuration="1m21.999057931s" totalImagesPullingTime="14.820259387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:08.998030034 +0000 UTC m=+83.243406738" watchObservedRunningTime="2026-07-28 20:26:08.999057931 +0000 UTC m=+83.244434631"
Jul 28 20:26:09.029440 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:09.029360    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-frl28" podStartSLOduration=52.678819348 podStartE2EDuration="1m7.029339222s" totalImagesPullingTime="14.350519874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:09.028129846 +0000 UTC m=+83.273506548" watchObservedRunningTime="2026-07-28 20:26:09.029339222 +0000 UTC m=+83.274715926"
Jul 28 20:26:12.779973 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:12.779913    2555 patch_prober.go:28] interesting pod/image-registry-95c869d68-xqmpx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 20:26:12.780472 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:12.780003    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-95c869d68-xqmpx" podUID="dbd7039c-be85-49ee-bbab-f211b61ddaab" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:26:14.767267 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:14.767236    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:26:16.796385 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:16.796347    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-95c869d68-xqmpx"]
Jul 28 20:26:17.537122 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.537084    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v9c6w"]
Jul 28 20:26:17.624732 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.624699    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.628801 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.627716    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 20:26:17.628801 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.628127    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ml6l9\""
Jul 28 20:26:17.628801 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.628516    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 20:26:17.628801 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.628738    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 20:26:17.629129 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.628951    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 20:26:17.687805 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.687752    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe23709d-7f8b-4b19-af12-99289a729b5d-sys\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.688010 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.687811    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe23709d-7f8b-4b19-af12-99289a729b5d-node-exporter-tls\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.688010 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.687837    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe23709d-7f8b-4b19-af12-99289a729b5d-root\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.688010 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.687875    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe23709d-7f8b-4b19-af12-99289a729b5d-node-exporter-wtmp\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.688010 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.687904    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe23709d-7f8b-4b19-af12-99289a729b5d-metrics-client-ca\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.688010 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.687946    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bln8\" (UniqueName: \"kubernetes.io/projected/fe23709d-7f8b-4b19-af12-99289a729b5d-kube-api-access-8bln8\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.688010 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.687985    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe23709d-7f8b-4b19-af12-99289a729b5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.688010 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.688014    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe23709d-7f8b-4b19-af12-99289a729b5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.688371 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.688074    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe23709d-7f8b-4b19-af12-99289a729b5d-node-exporter-textfile\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.789479 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.789390    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe23709d-7f8b-4b19-af12-99289a729b5d-node-exporter-wtmp\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.789479 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.789434    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe23709d-7f8b-4b19-af12-99289a729b5d-metrics-client-ca\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.789479 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.789463    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bln8\" (UniqueName: \"kubernetes.io/projected/fe23709d-7f8b-4b19-af12-99289a729b5d-kube-api-access-8bln8\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.789743 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.789496    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe23709d-7f8b-4b19-af12-99289a729b5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.789743 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.789524    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe23709d-7f8b-4b19-af12-99289a729b5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.789743 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.789551    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe23709d-7f8b-4b19-af12-99289a729b5d-node-exporter-textfile\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.789743 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.789600    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe23709d-7f8b-4b19-af12-99289a729b5d-node-exporter-wtmp\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.789743 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.789603    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe23709d-7f8b-4b19-af12-99289a729b5d-sys\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.789743 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.789646    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe23709d-7f8b-4b19-af12-99289a729b5d-sys\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.789743 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.789688    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe23709d-7f8b-4b19-af12-99289a729b5d-node-exporter-tls\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.789743 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.789723    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe23709d-7f8b-4b19-af12-99289a729b5d-root\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.790149 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.789784    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe23709d-7f8b-4b19-af12-99289a729b5d-root\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.790149 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.790104    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe23709d-7f8b-4b19-af12-99289a729b5d-metrics-client-ca\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.790376 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.790355    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe23709d-7f8b-4b19-af12-99289a729b5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.790429 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.790358    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe23709d-7f8b-4b19-af12-99289a729b5d-node-exporter-textfile\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.792888 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.792839    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe23709d-7f8b-4b19-af12-99289a729b5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.793053 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.792992    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe23709d-7f8b-4b19-af12-99289a729b5d-node-exporter-tls\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.799393 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.799335    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bln8\" (UniqueName: \"kubernetes.io/projected/fe23709d-7f8b-4b19-af12-99289a729b5d-kube-api-access-8bln8\") pod \"node-exporter-v9c6w\" (UID: \"fe23709d-7f8b-4b19-af12-99289a729b5d\") " pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:17.940534 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:17.940496    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v9c6w"
Jul 28 20:26:18.880005 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:18.879978    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-whjpl"
Jul 28 20:26:19.441613 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:26:19.441578    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe23709d_7f8b_4b19_af12_99289a729b5d.slice/crio-871125380cb5298c33b14b74a7e2535a3b0ad5bf3f4483355fdaaaa9607e7cdb WatchSource:0}: Error finding container 871125380cb5298c33b14b74a7e2535a3b0ad5bf3f4483355fdaaaa9607e7cdb: Status 404 returned error can't find the container with id 871125380cb5298c33b14b74a7e2535a3b0ad5bf3f4483355fdaaaa9607e7cdb
Jul 28 20:26:19.932659 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:19.932246    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-fnswx" event={"ID":"fa4518af-977d-4c93-94a3-711eb64f3dc1","Type":"ContainerStarted","Data":"72d4d131eab21121b07594c1c631a42cc737beac556315cd4e5cb5d9dde682fe"}
Jul 28 20:26:19.932659 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:19.932629    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-fnswx"
Jul 28 20:26:19.936053 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:19.936014    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d56fs" event={"ID":"16ccfe8d-c942-44d4-84dd-e7d584e2078e","Type":"ContainerStarted","Data":"8f96a74333853e7fa5f6118f343d5d075d7fc15e63feddf79f9bbcf8935ac024"}
Jul 28 20:26:19.937359 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:19.937297    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v9c6w" event={"ID":"fe23709d-7f8b-4b19-af12-99289a729b5d","Type":"ContainerStarted","Data":"871125380cb5298c33b14b74a7e2535a3b0ad5bf3f4483355fdaaaa9607e7cdb"}
Jul 28 20:26:19.940332 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:19.940310    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-fnswx"
Jul 28 20:26:19.982630 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:19.982509    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-fnswx" podStartSLOduration=1.9924074790000001 podStartE2EDuration="26.982487595s" totalImagesPullingTime="24.990080116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:19.961915143 +0000 UTC m=+94.207291847" watchObservedRunningTime="2026-07-28 20:26:19.982487595 +0000 UTC m=+94.227864300"
Jul 28 20:26:21.949769 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:21.949724    2555 generic.go:356] "Generic (PLEG): container finished" podID="fe23709d-7f8b-4b19-af12-99289a729b5d" containerID="adfc9b1174858d58a2c848bc80bfb3605b1f158a2284c06dbe82868a98c2a576" exitCode=0
Jul 28 20:26:21.950300 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:21.949814    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v9c6w" event={"ID":"fe23709d-7f8b-4b19-af12-99289a729b5d","Type":"ContainerDied","Data":"adfc9b1174858d58a2c848bc80bfb3605b1f158a2284c06dbe82868a98c2a576"}
Jul 28 20:26:21.973009 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:21.972952    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d56fs" podStartSLOduration=19.375668834 podStartE2EDuration="50.97290818s" totalImagesPullingTime="31.597239346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:25:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:20.01134313 +0000 UTC m=+94.256719834" watchObservedRunningTime="2026-07-28 20:26:21.97290818 +0000 UTC m=+96.218284882"
Jul 28 20:26:22.958197 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:22.958154    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v9c6w" event={"ID":"fe23709d-7f8b-4b19-af12-99289a729b5d","Type":"ContainerStarted","Data":"95574af5a695fe0cd5f17212fe901de8c79ddf073208dd88c71a7a6ee9c1506a"}
Jul 28 20:26:22.958669 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:22.958234    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v9c6w" event={"ID":"fe23709d-7f8b-4b19-af12-99289a729b5d","Type":"ContainerStarted","Data":"0251087cb69ee76c662aa7d67a9097596fe6942bf41e3cbd37f2b5b89af24d8d"}
Jul 28 20:26:22.979096 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:22.979046    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v9c6w" podStartSLOduration=4.278205159 podStartE2EDuration="5.979028534s" totalImagesPullingTime="1.604296226s" totalInitContainerRuntime="96.527149ms" isStatefulPod=true podCreationTimestamp="2026-07-28 20:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:22.976899691 +0000 UTC m=+97.222276403" watchObservedRunningTime="2026-07-28 20:26:22.979028534 +0000 UTC m=+97.224405236"
Jul 28 20:26:25.782752 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:25.782718    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dnptj"
Jul 28 20:26:36.013713 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:36.013674    2555 generic.go:356] "Generic (PLEG): container finished" podID="b6dffdb7-1adc-4a33-86db-e77751cc4fb1" containerID="56299ae36f0238ab8f14426459d0f5fa2b6bb47a492e9d63ab8bf4728aff1275" exitCode=0
Jul 28 20:26:36.014283 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:36.013754    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7" event={"ID":"b6dffdb7-1adc-4a33-86db-e77751cc4fb1","Type":"ContainerDied","Data":"56299ae36f0238ab8f14426459d0f5fa2b6bb47a492e9d63ab8bf4728aff1275"}
Jul 28 20:26:36.014283 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:36.014198    2555 scope.go:117] "RemoveContainer" containerID="56299ae36f0238ab8f14426459d0f5fa2b6bb47a492e9d63ab8bf4728aff1275"
Jul 28 20:26:37.019425 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:37.019388    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-5zvj7" event={"ID":"b6dffdb7-1adc-4a33-86db-e77751cc4fb1","Type":"ContainerStarted","Data":"827dbbe32015e31768019951a8451fc3098110acca68e9df313c55fe4a0fea27"}
Jul 28 20:26:41.819282 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:41.819234    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-95c869d68-xqmpx" podUID="dbd7039c-be85-49ee-bbab-f211b61ddaab" containerName="registry" containerID="cri-o://66f95f6932e3c74844195d7c71ea12d8d812c660818fbf6ea35cb2bc4824443a" gracePeriod=30
Jul 28 20:26:42.041198 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.041164    2555 generic.go:356] "Generic (PLEG): container finished" podID="dbd7039c-be85-49ee-bbab-f211b61ddaab" containerID="66f95f6932e3c74844195d7c71ea12d8d812c660818fbf6ea35cb2bc4824443a" exitCode=0
Jul 28 20:26:42.041358 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.041215    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-95c869d68-xqmpx" event={"ID":"dbd7039c-be85-49ee-bbab-f211b61ddaab","Type":"ContainerDied","Data":"66f95f6932e3c74844195d7c71ea12d8d812c660818fbf6ea35cb2bc4824443a"}
Jul 28 20:26:42.105556 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.105522    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:26:42.205373 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.205342    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbd7039c-be85-49ee-bbab-f211b61ddaab-installation-pull-secrets\") pod \"dbd7039c-be85-49ee-bbab-f211b61ddaab\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") "
Jul 28 20:26:42.205537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.205395    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbd7039c-be85-49ee-bbab-f211b61ddaab-image-registry-private-configuration\") pod \"dbd7039c-be85-49ee-bbab-f211b61ddaab\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") "
Jul 28 20:26:42.205537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.205442    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-certificates\") pod \"dbd7039c-be85-49ee-bbab-f211b61ddaab\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") "
Jul 28 20:26:42.205672 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.205530    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls\") pod \"dbd7039c-be85-49ee-bbab-f211b61ddaab\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") "
Jul 28 20:26:42.205672 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.205573    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgdvv\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-kube-api-access-wgdvv\") pod \"dbd7039c-be85-49ee-bbab-f211b61ddaab\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") "
Jul 28 20:26:42.205776 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.205761    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbd7039c-be85-49ee-bbab-f211b61ddaab-ca-trust-extracted\") pod \"dbd7039c-be85-49ee-bbab-f211b61ddaab\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") "
Jul 28 20:26:42.205836 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.205821    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-bound-sa-token\") pod \"dbd7039c-be85-49ee-bbab-f211b61ddaab\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") "
Jul 28 20:26:42.205898 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.205830    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dbd7039c-be85-49ee-bbab-f211b61ddaab" (UID: "dbd7039c-be85-49ee-bbab-f211b61ddaab"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:26:42.205898 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.205881    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbd7039c-be85-49ee-bbab-f211b61ddaab-trusted-ca\") pod \"dbd7039c-be85-49ee-bbab-f211b61ddaab\" (UID: \"dbd7039c-be85-49ee-bbab-f211b61ddaab\") "
Jul 28 20:26:42.206192 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.206147    2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-certificates\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:26:42.206425 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.206364    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbd7039c-be85-49ee-bbab-f211b61ddaab-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dbd7039c-be85-49ee-bbab-f211b61ddaab" (UID: "dbd7039c-be85-49ee-bbab-f211b61ddaab"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:26:42.208119 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.208087    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbd7039c-be85-49ee-bbab-f211b61ddaab-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dbd7039c-be85-49ee-bbab-f211b61ddaab" (UID: "dbd7039c-be85-49ee-bbab-f211b61ddaab"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:26:42.208240 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.208163    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbd7039c-be85-49ee-bbab-f211b61ddaab-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dbd7039c-be85-49ee-bbab-f211b61ddaab" (UID: "dbd7039c-be85-49ee-bbab-f211b61ddaab"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:26:42.208303 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.208274    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-kube-api-access-wgdvv" (OuterVolumeSpecName: "kube-api-access-wgdvv") pod "dbd7039c-be85-49ee-bbab-f211b61ddaab" (UID: "dbd7039c-be85-49ee-bbab-f211b61ddaab"). InnerVolumeSpecName "kube-api-access-wgdvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:26:42.208375 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.208356    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dbd7039c-be85-49ee-bbab-f211b61ddaab" (UID: "dbd7039c-be85-49ee-bbab-f211b61ddaab"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:26:42.208448 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.208426    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dbd7039c-be85-49ee-bbab-f211b61ddaab" (UID: "dbd7039c-be85-49ee-bbab-f211b61ddaab"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:26:42.214714 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.214683    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbd7039c-be85-49ee-bbab-f211b61ddaab-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dbd7039c-be85-49ee-bbab-f211b61ddaab" (UID: "dbd7039c-be85-49ee-bbab-f211b61ddaab"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:26:42.307306 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.307278    2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbd7039c-be85-49ee-bbab-f211b61ddaab-ca-trust-extracted\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:26:42.307306 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.307305    2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-bound-sa-token\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:26:42.307468 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.307315    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbd7039c-be85-49ee-bbab-f211b61ddaab-trusted-ca\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:26:42.307468 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.307323    2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbd7039c-be85-49ee-bbab-f211b61ddaab-installation-pull-secrets\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:26:42.307468 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.307333    2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbd7039c-be85-49ee-bbab-f211b61ddaab-image-registry-private-configuration\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:26:42.307468 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.307342    2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-registry-tls\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:26:42.307468 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:42.307350    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgdvv\" (UniqueName: \"kubernetes.io/projected/dbd7039c-be85-49ee-bbab-f211b61ddaab-kube-api-access-wgdvv\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:26:43.046255 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:43.046217    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-95c869d68-xqmpx" event={"ID":"dbd7039c-be85-49ee-bbab-f211b61ddaab","Type":"ContainerDied","Data":"5f245ca5686dfdf03992a1349bb4d4992ac6d555691a7e45bb8a0467081f2bd4"}
Jul 28 20:26:43.046255 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:43.046250    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-95c869d68-xqmpx"
Jul 28 20:26:43.046851 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:43.046289    2555 scope.go:117] "RemoveContainer" containerID="66f95f6932e3c74844195d7c71ea12d8d812c660818fbf6ea35cb2bc4824443a"
Jul 28 20:26:43.067553 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:43.067523    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-95c869d68-xqmpx"]
Jul 28 20:26:43.075408 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:43.075376    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-95c869d68-xqmpx"]
Jul 28 20:26:44.295097 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:44.295058    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbd7039c-be85-49ee-bbab-f211b61ddaab" path="/var/lib/kubelet/pods/dbd7039c-be85-49ee-bbab-f211b61ddaab/volumes"
Jul 28 20:26:51.084735 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:51.084644    2555 generic.go:356] "Generic (PLEG): container finished" podID="f8c3a22f-34cb-4baa-b9d8-d568862990f2" containerID="d7d44d800d4ed38e73b62b3d54bbd27e7527f9db0ad4d7b577eec6d6d91fea90" exitCode=0
Jul 28 20:26:51.084735 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:51.084710    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-zj7nr" event={"ID":"f8c3a22f-34cb-4baa-b9d8-d568862990f2","Type":"ContainerDied","Data":"d7d44d800d4ed38e73b62b3d54bbd27e7527f9db0ad4d7b577eec6d6d91fea90"}
Jul 28 20:26:51.085181 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:51.085080    2555 scope.go:117] "RemoveContainer" containerID="d7d44d800d4ed38e73b62b3d54bbd27e7527f9db0ad4d7b577eec6d6d91fea90"
Jul 28 20:26:52.090109 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:52.090072    2555 generic.go:356] "Generic (PLEG): container finished" podID="08c5e2aa-c647-43ba-b193-2010926ef41d" containerID="d89953f238f58d528126a4791f7b36a9d8228ae3169cc0623dd7c0bf51816e67" exitCode=0
Jul 28 20:26:52.090562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:52.090142    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p" event={"ID":"08c5e2aa-c647-43ba-b193-2010926ef41d","Type":"ContainerDied","Data":"d89953f238f58d528126a4791f7b36a9d8228ae3169cc0623dd7c0bf51816e67"}
Jul 28 20:26:52.090562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:52.090517    2555 scope.go:117] "RemoveContainer" containerID="d89953f238f58d528126a4791f7b36a9d8228ae3169cc0623dd7c0bf51816e67"
Jul 28 20:26:52.092242 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:52.092221    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-zj7nr" event={"ID":"f8c3a22f-34cb-4baa-b9d8-d568862990f2","Type":"ContainerStarted","Data":"8084a968462bf30bf1ef48bfeee4970014f7631d635da428dceccd70c7c2095e"}
Jul 28 20:26:53.098096 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:26:53.098059    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-67p4p" event={"ID":"08c5e2aa-c647-43ba-b193-2010926ef41d","Type":"ContainerStarted","Data":"a06bfacf3780daaeec544f72e2bb1619407e9875a9921fb13a9c3670081ce7fd"}
Jul 28 20:29:46.182552 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:29:46.182522    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:29:46.192867 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:29:46.192819    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:29:46.193049 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:29:46.192854    2555 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 20:30:07.350043 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.350009    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"]
Jul 28 20:30:07.352377 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.350325    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbd7039c-be85-49ee-bbab-f211b61ddaab" containerName="registry"
Jul 28 20:30:07.352377 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.350336    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbd7039c-be85-49ee-bbab-f211b61ddaab" containerName="registry"
Jul 28 20:30:07.352377 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.350395    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbd7039c-be85-49ee-bbab-f211b61ddaab" containerName="registry"
Jul 28 20:30:07.353249 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.353229    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.356134 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.356113    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 20:30:07.357159 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.357141    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sr7hb\""
Jul 28 20:30:07.357254 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.357219    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 20:30:07.357254 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.357228    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 20:30:07.359268 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.359248    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 20:30:07.377417 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.377389    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"]
Jul 28 20:30:07.453892 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.453854    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ac6ba921-e99d-4f78-a8a7-5b822dcc62e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56794f8cc8-p7tjj\" (UID: \"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.454063 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.453902    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac6ba921-e99d-4f78-a8a7-5b822dcc62e0-tmp\") pod \"opendatahub-operator-controller-manager-56794f8cc8-p7tjj\" (UID: \"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.454063 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.453922    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac6ba921-e99d-4f78-a8a7-5b822dcc62e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-56794f8cc8-p7tjj\" (UID: \"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.454063 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.454017    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ac6ba921-e99d-4f78-a8a7-5b822dcc62e0-manifests\") pod \"opendatahub-operator-controller-manager-56794f8cc8-p7tjj\" (UID: \"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.454183 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.454075    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nvc2\" (UniqueName: \"kubernetes.io/projected/ac6ba921-e99d-4f78-a8a7-5b822dcc62e0-kube-api-access-9nvc2\") pod \"opendatahub-operator-controller-manager-56794f8cc8-p7tjj\" (UID: \"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.554810 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.554777    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac6ba921-e99d-4f78-a8a7-5b822dcc62e0-tmp\") pod \"opendatahub-operator-controller-manager-56794f8cc8-p7tjj\" (UID: \"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.554810 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.554814    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac6ba921-e99d-4f78-a8a7-5b822dcc62e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-56794f8cc8-p7tjj\" (UID: \"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.555045 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.554839    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ac6ba921-e99d-4f78-a8a7-5b822dcc62e0-manifests\") pod \"opendatahub-operator-controller-manager-56794f8cc8-p7tjj\" (UID: \"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.555045 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.554881    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nvc2\" (UniqueName: \"kubernetes.io/projected/ac6ba921-e99d-4f78-a8a7-5b822dcc62e0-kube-api-access-9nvc2\") pod \"opendatahub-operator-controller-manager-56794f8cc8-p7tjj\" (UID: \"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.555045 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.554906    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ac6ba921-e99d-4f78-a8a7-5b822dcc62e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56794f8cc8-p7tjj\" (UID: \"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.555330 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.555305    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ac6ba921-e99d-4f78-a8a7-5b822dcc62e0-manifests\") pod \"opendatahub-operator-controller-manager-56794f8cc8-p7tjj\" (UID: \"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.557183 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.557158    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac6ba921-e99d-4f78-a8a7-5b822dcc62e0-tmp\") pod \"opendatahub-operator-controller-manager-56794f8cc8-p7tjj\" (UID: \"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.557390 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.557369    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac6ba921-e99d-4f78-a8a7-5b822dcc62e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-56794f8cc8-p7tjj\" (UID: \"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.557431 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.557369    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ac6ba921-e99d-4f78-a8a7-5b822dcc62e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56794f8cc8-p7tjj\" (UID: \"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.575114 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.575092    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nvc2\" (UniqueName: \"kubernetes.io/projected/ac6ba921-e99d-4f78-a8a7-5b822dcc62e0-kube-api-access-9nvc2\") pod \"opendatahub-operator-controller-manager-56794f8cc8-p7tjj\" (UID: \"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.663276 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.663165    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:07.802328 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.802289    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"]
Jul 28 20:30:07.806756 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:30:07.806731    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac6ba921_e99d_4f78_a8a7_5b822dcc62e0.slice/crio-a8cd2787e4c799c2d965cff9e1fcd85600fef7f32b6bc43db90e6063c937938e WatchSource:0}: Error finding container a8cd2787e4c799c2d965cff9e1fcd85600fef7f32b6bc43db90e6063c937938e: Status 404 returned error can't find the container with id a8cd2787e4c799c2d965cff9e1fcd85600fef7f32b6bc43db90e6063c937938e
Jul 28 20:30:07.808492 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.808476    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:30:07.839614 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:07.839582    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj" event={"ID":"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0","Type":"ContainerStarted","Data":"a8cd2787e4c799c2d965cff9e1fcd85600fef7f32b6bc43db90e6063c937938e"}
Jul 28 20:30:10.857144 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:10.857111    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj" event={"ID":"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0","Type":"ContainerStarted","Data":"ce6090ed52e244cfe1401323a4e21aafce0ece11004932de9cf329e1ac17766b"}
Jul 28 20:30:11.862639 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:11.862606    2555 generic.go:356] "Generic (PLEG): container finished" podID="ac6ba921-e99d-4f78-a8a7-5b822dcc62e0" containerID="ce6090ed52e244cfe1401323a4e21aafce0ece11004932de9cf329e1ac17766b" exitCode=0
Jul 28 20:30:11.863047 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:11.862695    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj" event={"ID":"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0","Type":"ContainerDied","Data":"ce6090ed52e244cfe1401323a4e21aafce0ece11004932de9cf329e1ac17766b"}
Jul 28 20:30:12.868806 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:12.868768    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj" event={"ID":"ac6ba921-e99d-4f78-a8a7-5b822dcc62e0","Type":"ContainerStarted","Data":"5fbbfceaec90f3572987ccc985def0cf9d4cd24a945a96bc7fde595062ede759"}
Jul 28 20:30:12.869247 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:12.868910    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:12.905015 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:12.904950    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj" podStartSLOduration=1.474459545 podStartE2EDuration="5.90491818s" totalImagesPullingTime="3.42819462s" totalInitContainerRuntime="1.002264015s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:30:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:30:12.904530585 +0000 UTC m=+327.149907312" watchObservedRunningTime="2026-07-28 20:30:12.90491818 +0000 UTC m=+327.150294880"
Jul 28 20:30:23.874610 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:23.874574    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-p7tjj"
Jul 28 20:30:35.570033 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.569998    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"]
Jul 28 20:30:35.585680 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.585649    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.589987 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.589953    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8284031-62bd-4acd-807d-34b0fcd0e9b5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.590148 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.590011    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8284031-62bd-4acd-807d-34b0fcd0e9b5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.590148 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.590040    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8284031-62bd-4acd-807d-34b0fcd0e9b5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.590148 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.590090    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8qpm\" (UniqueName: \"kubernetes.io/projected/a8284031-62bd-4acd-807d-34b0fcd0e9b5-kube-api-access-k8qpm\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.590312 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.590155    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8284031-62bd-4acd-807d-34b0fcd0e9b5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.590312 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.590182    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8284031-62bd-4acd-807d-34b0fcd0e9b5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.590312 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.590211    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8284031-62bd-4acd-807d-34b0fcd0e9b5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.590312 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.590242    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8284031-62bd-4acd-807d-34b0fcd0e9b5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.590312 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.590288    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8284031-62bd-4acd-807d-34b0fcd0e9b5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.590632 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.590603    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2wsmr\""
Jul 28 20:30:35.591039 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.590900    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 20:30:35.591685 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.591663    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"]
Jul 28 20:30:35.691094 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.691060    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8284031-62bd-4acd-807d-34b0fcd0e9b5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.691094 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.691098    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8284031-62bd-4acd-807d-34b0fcd0e9b5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.691361 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.691129    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8qpm\" (UniqueName: \"kubernetes.io/projected/a8284031-62bd-4acd-807d-34b0fcd0e9b5-kube-api-access-k8qpm\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.691361 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.691167    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8284031-62bd-4acd-807d-34b0fcd0e9b5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.691361 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.691185    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8284031-62bd-4acd-807d-34b0fcd0e9b5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.691361 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.691206    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8284031-62bd-4acd-807d-34b0fcd0e9b5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.691361 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.691239    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8284031-62bd-4acd-807d-34b0fcd0e9b5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.691597 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.691453    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8284031-62bd-4acd-807d-34b0fcd0e9b5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.691597 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.691509    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8284031-62bd-4acd-807d-34b0fcd0e9b5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.691597 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.691518    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8284031-62bd-4acd-807d-34b0fcd0e9b5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.691597 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.691573    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8284031-62bd-4acd-807d-34b0fcd0e9b5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.691746 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.691654    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8284031-62bd-4acd-807d-34b0fcd0e9b5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.691746 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.691691    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8284031-62bd-4acd-807d-34b0fcd0e9b5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.692160 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.692140    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8284031-62bd-4acd-807d-34b0fcd0e9b5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.693723 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.693695    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8284031-62bd-4acd-807d-34b0fcd0e9b5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.693921 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.693903    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8284031-62bd-4acd-807d-34b0fcd0e9b5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.726434 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.726403    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8284031-62bd-4acd-807d-34b0fcd0e9b5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.729688 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.729657    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8qpm\" (UniqueName: \"kubernetes.io/projected/a8284031-62bd-4acd-807d-34b0fcd0e9b5-kube-api-access-k8qpm\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj\" (UID: \"a8284031-62bd-4acd-807d-34b0fcd0e9b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:35.898317 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:35.898233    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:36.064461 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:36.064437    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"]
Jul 28 20:30:36.067080 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:30:36.067055    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8284031_62bd_4acd_807d_34b0fcd0e9b5.slice/crio-9d2da1566a87ce4112db6bd62b86ad0808b1575eb3025370ffcae1ab02844914 WatchSource:0}: Error finding container 9d2da1566a87ce4112db6bd62b86ad0808b1575eb3025370ffcae1ab02844914: Status 404 returned error can't find the container with id 9d2da1566a87ce4112db6bd62b86ad0808b1575eb3025370ffcae1ab02844914
Jul 28 20:30:36.978893 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:36.978853    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj" event={"ID":"a8284031-62bd-4acd-807d-34b0fcd0e9b5","Type":"ContainerStarted","Data":"9d2da1566a87ce4112db6bd62b86ad0808b1575eb3025370ffcae1ab02844914"}
Jul 28 20:30:38.375025 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.374938    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"]
Jul 28 20:30:38.378673 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.378650    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"
Jul 28 20:30:38.383802 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.383774    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 28 20:30:38.384024 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.384000    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 28 20:30:38.384680 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.384657    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 28 20:30:38.384780 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.384668    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:30:38.384780 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.384743    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dfkjn\""
Jul 28 20:30:38.385650 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.385585    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 28 20:30:38.400691 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.400662    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"]
Jul 28 20:30:38.414408 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.414381    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wwfg\" (UniqueName: \"kubernetes.io/projected/526e728b-20ab-4852-99ba-0ddb7b2990ae-kube-api-access-2wwfg\") pod \"lws-controller-manager-54dcc5fbb6-mcjdm\" (UID: \"526e728b-20ab-4852-99ba-0ddb7b2990ae\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"
Jul 28 20:30:38.414539 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.414461    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/526e728b-20ab-4852-99ba-0ddb7b2990ae-manager-config\") pod \"lws-controller-manager-54dcc5fbb6-mcjdm\" (UID: \"526e728b-20ab-4852-99ba-0ddb7b2990ae\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"
Jul 28 20:30:38.414539 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.414493    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/526e728b-20ab-4852-99ba-0ddb7b2990ae-cert\") pod \"lws-controller-manager-54dcc5fbb6-mcjdm\" (UID: \"526e728b-20ab-4852-99ba-0ddb7b2990ae\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"
Jul 28 20:30:38.414539 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.414533    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/526e728b-20ab-4852-99ba-0ddb7b2990ae-metrics-cert\") pod \"lws-controller-manager-54dcc5fbb6-mcjdm\" (UID: \"526e728b-20ab-4852-99ba-0ddb7b2990ae\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"
Jul 28 20:30:38.515298 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.515254    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/526e728b-20ab-4852-99ba-0ddb7b2990ae-metrics-cert\") pod \"lws-controller-manager-54dcc5fbb6-mcjdm\" (UID: \"526e728b-20ab-4852-99ba-0ddb7b2990ae\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"
Jul 28 20:30:38.515481 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.515367    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wwfg\" (UniqueName: \"kubernetes.io/projected/526e728b-20ab-4852-99ba-0ddb7b2990ae-kube-api-access-2wwfg\") pod \"lws-controller-manager-54dcc5fbb6-mcjdm\" (UID: \"526e728b-20ab-4852-99ba-0ddb7b2990ae\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"
Jul 28 20:30:38.515481 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.515409    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/526e728b-20ab-4852-99ba-0ddb7b2990ae-manager-config\") pod \"lws-controller-manager-54dcc5fbb6-mcjdm\" (UID: \"526e728b-20ab-4852-99ba-0ddb7b2990ae\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"
Jul 28 20:30:38.515481 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.515437    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/526e728b-20ab-4852-99ba-0ddb7b2990ae-cert\") pod \"lws-controller-manager-54dcc5fbb6-mcjdm\" (UID: \"526e728b-20ab-4852-99ba-0ddb7b2990ae\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"
Jul 28 20:30:38.516295 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.516266    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/526e728b-20ab-4852-99ba-0ddb7b2990ae-manager-config\") pod \"lws-controller-manager-54dcc5fbb6-mcjdm\" (UID: \"526e728b-20ab-4852-99ba-0ddb7b2990ae\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"
Jul 28 20:30:38.518369 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.518332    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/526e728b-20ab-4852-99ba-0ddb7b2990ae-cert\") pod \"lws-controller-manager-54dcc5fbb6-mcjdm\" (UID: \"526e728b-20ab-4852-99ba-0ddb7b2990ae\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"
Jul 28 20:30:38.518487 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.518434    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/526e728b-20ab-4852-99ba-0ddb7b2990ae-metrics-cert\") pod \"lws-controller-manager-54dcc5fbb6-mcjdm\" (UID: \"526e728b-20ab-4852-99ba-0ddb7b2990ae\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"
Jul 28 20:30:38.531969 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.531912    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wwfg\" (UniqueName: \"kubernetes.io/projected/526e728b-20ab-4852-99ba-0ddb7b2990ae-kube-api-access-2wwfg\") pod \"lws-controller-manager-54dcc5fbb6-mcjdm\" (UID: \"526e728b-20ab-4852-99ba-0ddb7b2990ae\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"
Jul 28 20:30:38.691086 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:38.690991    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"
Jul 28 20:30:39.302036 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:39.301983    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:30:39.302153 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:39.302073    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:30:39.302153 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:39.302108    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:30:39.367845 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:39.367822    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"]
Jul 28 20:30:39.369823 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:30:39.369800    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod526e728b_20ab_4852_99ba_0ddb7b2990ae.slice/crio-c069d1bd061e2269d996881bc50ad2d1efcc19e3b0fa5695e624a4e2e444e720 WatchSource:0}: Error finding container c069d1bd061e2269d996881bc50ad2d1efcc19e3b0fa5695e624a4e2e444e720: Status 404 returned error can't find the container with id c069d1bd061e2269d996881bc50ad2d1efcc19e3b0fa5695e624a4e2e444e720
Jul 28 20:30:39.993488 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:39.993446    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj" event={"ID":"a8284031-62bd-4acd-807d-34b0fcd0e9b5","Type":"ContainerStarted","Data":"1ecc4f88cd6a792d68ad4afeeb3ddd8fdaa11bd90bb9f7eff9ae361a53498a82"}
Jul 28 20:30:39.994628 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:39.994604    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm" event={"ID":"526e728b-20ab-4852-99ba-0ddb7b2990ae","Type":"ContainerStarted","Data":"c069d1bd061e2269d996881bc50ad2d1efcc19e3b0fa5695e624a4e2e444e720"}
Jul 28 20:30:40.064135 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:40.064082    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj" podStartSLOduration=1.831519944 podStartE2EDuration="5.064067225s" totalImagesPullingTime="3.232547281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:30:40.063033723 +0000 UTC m=+354.308410424" watchObservedRunningTime="2026-07-28 20:30:40.064067225 +0000 UTC m=+354.309443926"
Jul 28 20:30:40.898496 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:40.898455    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:40.902801 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:40.902773    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:40.999171 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:40.999143    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:41.000118 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:41.000098    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj"
Jul 28 20:30:46.023698 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:46.023656    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm" event={"ID":"526e728b-20ab-4852-99ba-0ddb7b2990ae","Type":"ContainerStarted","Data":"6e7e1f29838e378185f0da9256e313e5f27733662fd13b32b7040d0d867d6675"}
Jul 28 20:30:46.024117 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:46.023745    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"
Jul 28 20:30:46.041963 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:46.041803    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm" podStartSLOduration=2.283381801 podStartE2EDuration="8.041783093s" totalImagesPullingTime="5.758401292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:30:46.04022133 +0000 UTC m=+360.285598032" watchObservedRunningTime="2026-07-28 20:30:46.041783093 +0000 UTC m=+360.287159800"
Jul 28 20:30:57.030731 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:30:57.030699    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-mcjdm"
Jul 28 20:32:29.700024 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:29.697598    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"]
Jul 28 20:32:29.702383 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:29.702354    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"
Jul 28 20:32:29.705402 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:29.705359    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 20:32:29.705529 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:29.705426    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9kqgb\""
Jul 28 20:32:29.705529 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:29.705511    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 20:32:29.714552 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:29.714525    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"]
Jul 28 20:32:29.744809 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:29.744771    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlj5q\" (UniqueName: \"kubernetes.io/projected/c8176cd2-ccb9-478f-87ff-c8eeab2fe347-kube-api-access-nlj5q\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-p9cgs\" (UID: \"c8176cd2-ccb9-478f-87ff-c8eeab2fe347\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"
Jul 28 20:32:29.745003 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:29.744830    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8176cd2-ccb9-478f-87ff-c8eeab2fe347-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-p9cgs\" (UID: \"c8176cd2-ccb9-478f-87ff-c8eeab2fe347\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"
Jul 28 20:32:29.846185 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:29.846128    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlj5q\" (UniqueName: \"kubernetes.io/projected/c8176cd2-ccb9-478f-87ff-c8eeab2fe347-kube-api-access-nlj5q\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-p9cgs\" (UID: \"c8176cd2-ccb9-478f-87ff-c8eeab2fe347\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"
Jul 28 20:32:29.846185 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:29.846202    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8176cd2-ccb9-478f-87ff-c8eeab2fe347-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-p9cgs\" (UID: \"c8176cd2-ccb9-478f-87ff-c8eeab2fe347\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"
Jul 28 20:32:29.846555 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:29.846539    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8176cd2-ccb9-478f-87ff-c8eeab2fe347-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-p9cgs\" (UID: \"c8176cd2-ccb9-478f-87ff-c8eeab2fe347\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"
Jul 28 20:32:29.856229 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:29.856200    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlj5q\" (UniqueName: \"kubernetes.io/projected/c8176cd2-ccb9-478f-87ff-c8eeab2fe347-kube-api-access-nlj5q\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-p9cgs\" (UID: \"c8176cd2-ccb9-478f-87ff-c8eeab2fe347\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"
Jul 28 20:32:30.013219 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:30.013125    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"
Jul 28 20:32:30.151269 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:30.151227    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"]
Jul 28 20:32:30.155203 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:32:30.155174    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8176cd2_ccb9_478f_87ff_c8eeab2fe347.slice/crio-f5a62f63ccd09da39fa1d467716fe7d39a5e24a797e7a5e95d572ff717b5d6d4 WatchSource:0}: Error finding container f5a62f63ccd09da39fa1d467716fe7d39a5e24a797e7a5e95d572ff717b5d6d4: Status 404 returned error can't find the container with id f5a62f63ccd09da39fa1d467716fe7d39a5e24a797e7a5e95d572ff717b5d6d4
Jul 28 20:32:30.467671 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:30.467632    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs" event={"ID":"c8176cd2-ccb9-478f-87ff-c8eeab2fe347","Type":"ContainerStarted","Data":"f5a62f63ccd09da39fa1d467716fe7d39a5e24a797e7a5e95d572ff717b5d6d4"}
Jul 28 20:32:30.916037 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:30.916003    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"]
Jul 28 20:32:30.920334 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:30.920303    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"]
Jul 28 20:32:30.944191 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:30.944156    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"]
Jul 28 20:32:30.948005 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:30.947977    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"
Jul 28 20:32:30.976972 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:30.976920    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"]
Jul 28 20:32:31.056863 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:31.056831    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c55hc\" (UniqueName: \"kubernetes.io/projected/a3a9207a-723f-416a-a92d-84c084a9efe6-kube-api-access-c55hc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4vrwk\" (UID: \"a3a9207a-723f-416a-a92d-84c084a9efe6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"
Jul 28 20:32:31.057035 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:31.056946    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3a9207a-723f-416a-a92d-84c084a9efe6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4vrwk\" (UID: \"a3a9207a-723f-416a-a92d-84c084a9efe6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"
Jul 28 20:32:31.158316 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:31.158274    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3a9207a-723f-416a-a92d-84c084a9efe6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4vrwk\" (UID: \"a3a9207a-723f-416a-a92d-84c084a9efe6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"
Jul 28 20:32:31.158496 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:31.158388    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c55hc\" (UniqueName: \"kubernetes.io/projected/a3a9207a-723f-416a-a92d-84c084a9efe6-kube-api-access-c55hc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4vrwk\" (UID: \"a3a9207a-723f-416a-a92d-84c084a9efe6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"
Jul 28 20:32:31.158684 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:31.158660    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3a9207a-723f-416a-a92d-84c084a9efe6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4vrwk\" (UID: \"a3a9207a-723f-416a-a92d-84c084a9efe6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"
Jul 28 20:32:31.171494 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:31.171431    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c55hc\" (UniqueName: \"kubernetes.io/projected/a3a9207a-723f-416a-a92d-84c084a9efe6-kube-api-access-c55hc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4vrwk\" (UID: \"a3a9207a-723f-416a-a92d-84c084a9efe6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"
Jul 28 20:32:31.262493 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:31.262447    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"
Jul 28 20:32:31.568586 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:31.568550    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"]
Jul 28 20:32:31.574026 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:32:31.573997    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3a9207a_723f_416a_a92d_84c084a9efe6.slice/crio-b13e34cde0afe19be6ba575bb35f7f9f948c6b35cefbf59995b946dc7fcb82a7 WatchSource:0}: Error finding container b13e34cde0afe19be6ba575bb35f7f9f948c6b35cefbf59995b946dc7fcb82a7: Status 404 returned error can't find the container with id b13e34cde0afe19be6ba575bb35f7f9f948c6b35cefbf59995b946dc7fcb82a7
Jul 28 20:32:32.479564 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:32.479527    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk" event={"ID":"a3a9207a-723f-416a-a92d-84c084a9efe6","Type":"ContainerStarted","Data":"b13e34cde0afe19be6ba575bb35f7f9f948c6b35cefbf59995b946dc7fcb82a7"}
Jul 28 20:32:35.497665 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:35.497622    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk" event={"ID":"a3a9207a-723f-416a-a92d-84c084a9efe6","Type":"ContainerStarted","Data":"7e1d99d6065ae43209c4aecb972759744369a4132bf59900db6aa964e322d9c3"}
Jul 28 20:32:35.498138 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:35.497689    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"
Jul 28 20:32:35.499368 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:35.499277    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs" podUID="c8176cd2-ccb9-478f-87ff-c8eeab2fe347" containerName="manager" containerID="cri-o://db531d15e8e14aef8cecbf85789869cbadbe8bcdca64ece3ae63f33f49657339" gracePeriod=2
Jul 28 20:32:35.543320 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:35.543266    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk" podStartSLOduration=1.85685325 podStartE2EDuration="5.543249316s" totalImagesPullingTime="3.686396066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:32:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:32:35.540710605 +0000 UTC m=+469.786087343" watchObservedRunningTime="2026-07-28 20:32:35.543249316 +0000 UTC m=+469.788625996"
Jul 28 20:32:35.744752 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:35.744720    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"
Jul 28 20:32:35.747437 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:32:35.747411    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-p9cgs\" is forbidden: User \"system:node:ip-10-0-137-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-26.ec2.internal' and this object" podUID="c8176cd2-ccb9-478f-87ff-c8eeab2fe347" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"
Jul 28 20:32:35.803301 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:35.803198    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlj5q\" (UniqueName: \"kubernetes.io/projected/c8176cd2-ccb9-478f-87ff-c8eeab2fe347-kube-api-access-nlj5q\") pod \"c8176cd2-ccb9-478f-87ff-c8eeab2fe347\" (UID: \"c8176cd2-ccb9-478f-87ff-c8eeab2fe347\") "
Jul 28 20:32:35.803472 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:35.803306    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8176cd2-ccb9-478f-87ff-c8eeab2fe347-extensions-socket-volume\") pod \"c8176cd2-ccb9-478f-87ff-c8eeab2fe347\" (UID: \"c8176cd2-ccb9-478f-87ff-c8eeab2fe347\") "
Jul 28 20:32:35.803651 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:35.803613    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8176cd2-ccb9-478f-87ff-c8eeab2fe347-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c8176cd2-ccb9-478f-87ff-c8eeab2fe347" (UID: "c8176cd2-ccb9-478f-87ff-c8eeab2fe347"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:32:35.805641 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:35.805606    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8176cd2-ccb9-478f-87ff-c8eeab2fe347-kube-api-access-nlj5q" (OuterVolumeSpecName: "kube-api-access-nlj5q") pod "c8176cd2-ccb9-478f-87ff-c8eeab2fe347" (UID: "c8176cd2-ccb9-478f-87ff-c8eeab2fe347"). InnerVolumeSpecName "kube-api-access-nlj5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:32:35.904997 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:35.904953    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8176cd2-ccb9-478f-87ff-c8eeab2fe347-extensions-socket-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:32:35.904997 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:35.904993    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlj5q\" (UniqueName: \"kubernetes.io/projected/c8176cd2-ccb9-478f-87ff-c8eeab2fe347-kube-api-access-nlj5q\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:32:36.293884 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:32:36.293845    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-p9cgs\" is forbidden: User \"system:node:ip-10-0-137-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-26.ec2.internal' and this object" podUID="c8176cd2-ccb9-478f-87ff-c8eeab2fe347" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"
Jul 28 20:32:36.296668 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:36.296641    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8176cd2-ccb9-478f-87ff-c8eeab2fe347" path="/var/lib/kubelet/pods/c8176cd2-ccb9-478f-87ff-c8eeab2fe347/volumes"
Jul 28 20:32:36.505342 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:36.505305    2555 generic.go:356] "Generic (PLEG): container finished" podID="c8176cd2-ccb9-478f-87ff-c8eeab2fe347" containerID="db531d15e8e14aef8cecbf85789869cbadbe8bcdca64ece3ae63f33f49657339" exitCode=2
Jul 28 20:32:36.505788 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:36.505351    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"
Jul 28 20:32:36.505788 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:36.505362    2555 scope.go:117] "RemoveContainer" containerID="db531d15e8e14aef8cecbf85789869cbadbe8bcdca64ece3ae63f33f49657339"
Jul 28 20:32:36.510000 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:32:36.509969    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-p9cgs\" is forbidden: User \"system:node:ip-10-0-137-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-26.ec2.internal' and this object" podUID="c8176cd2-ccb9-478f-87ff-c8eeab2fe347" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-p9cgs"
Jul 28 20:32:36.513573 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:36.513549    2555 scope.go:117] "RemoveContainer" containerID="db531d15e8e14aef8cecbf85789869cbadbe8bcdca64ece3ae63f33f49657339"
Jul 28 20:32:36.513871 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:32:36.513850    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db531d15e8e14aef8cecbf85789869cbadbe8bcdca64ece3ae63f33f49657339\": container with ID starting with db531d15e8e14aef8cecbf85789869cbadbe8bcdca64ece3ae63f33f49657339 not found: ID does not exist" containerID="db531d15e8e14aef8cecbf85789869cbadbe8bcdca64ece3ae63f33f49657339"
Jul 28 20:32:36.513953 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:36.513885    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db531d15e8e14aef8cecbf85789869cbadbe8bcdca64ece3ae63f33f49657339"} err="failed to get container status \"db531d15e8e14aef8cecbf85789869cbadbe8bcdca64ece3ae63f33f49657339\": rpc error: code = NotFound desc = could not find container \"db531d15e8e14aef8cecbf85789869cbadbe8bcdca64ece3ae63f33f49657339\": container with ID starting with db531d15e8e14aef8cecbf85789869cbadbe8bcdca64ece3ae63f33f49657339 not found: ID does not exist"
Jul 28 20:32:46.508225 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:46.508143    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"
Jul 28 20:32:58.662994 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:58.662950    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"]
Jul 28 20:32:58.663524 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:58.663161    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk" podUID="a3a9207a-723f-416a-a92d-84c084a9efe6" containerName="manager" containerID="cri-o://7e1d99d6065ae43209c4aecb972759744369a4132bf59900db6aa964e322d9c3" gracePeriod=10
Jul 28 20:32:58.918015 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:58.917957    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"
Jul 28 20:32:58.999626 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:58.999593    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c55hc\" (UniqueName: \"kubernetes.io/projected/a3a9207a-723f-416a-a92d-84c084a9efe6-kube-api-access-c55hc\") pod \"a3a9207a-723f-416a-a92d-84c084a9efe6\" (UID: \"a3a9207a-723f-416a-a92d-84c084a9efe6\") "
Jul 28 20:32:58.999803 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:58.999720    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3a9207a-723f-416a-a92d-84c084a9efe6-extensions-socket-volume\") pod \"a3a9207a-723f-416a-a92d-84c084a9efe6\" (UID: \"a3a9207a-723f-416a-a92d-84c084a9efe6\") "
Jul 28 20:32:59.000124 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:59.000096    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3a9207a-723f-416a-a92d-84c084a9efe6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a3a9207a-723f-416a-a92d-84c084a9efe6" (UID: "a3a9207a-723f-416a-a92d-84c084a9efe6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:32:59.001696 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:59.001670    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3a9207a-723f-416a-a92d-84c084a9efe6-kube-api-access-c55hc" (OuterVolumeSpecName: "kube-api-access-c55hc") pod "a3a9207a-723f-416a-a92d-84c084a9efe6" (UID: "a3a9207a-723f-416a-a92d-84c084a9efe6"). InnerVolumeSpecName "kube-api-access-c55hc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:32:59.101261 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:59.101223    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3a9207a-723f-416a-a92d-84c084a9efe6-extensions-socket-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:32:59.101261 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:59.101254    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c55hc\" (UniqueName: \"kubernetes.io/projected/a3a9207a-723f-416a-a92d-84c084a9efe6-kube-api-access-c55hc\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:32:59.609176 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:59.609145    2555 generic.go:356] "Generic (PLEG): container finished" podID="a3a9207a-723f-416a-a92d-84c084a9efe6" containerID="7e1d99d6065ae43209c4aecb972759744369a4132bf59900db6aa964e322d9c3" exitCode=0
Jul 28 20:32:59.609351 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:59.609192    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"
Jul 28 20:32:59.609351 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:59.609214    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk" event={"ID":"a3a9207a-723f-416a-a92d-84c084a9efe6","Type":"ContainerDied","Data":"7e1d99d6065ae43209c4aecb972759744369a4132bf59900db6aa964e322d9c3"}
Jul 28 20:32:59.609351 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:59.609264    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk" event={"ID":"a3a9207a-723f-416a-a92d-84c084a9efe6","Type":"ContainerDied","Data":"b13e34cde0afe19be6ba575bb35f7f9f948c6b35cefbf59995b946dc7fcb82a7"}
Jul 28 20:32:59.609351 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:59.609286    2555 scope.go:117] "RemoveContainer" containerID="7e1d99d6065ae43209c4aecb972759744369a4132bf59900db6aa964e322d9c3"
Jul 28 20:32:59.618027 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:59.617914    2555 scope.go:117] "RemoveContainer" containerID="7e1d99d6065ae43209c4aecb972759744369a4132bf59900db6aa964e322d9c3"
Jul 28 20:32:59.618237 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:32:59.618220    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1d99d6065ae43209c4aecb972759744369a4132bf59900db6aa964e322d9c3\": container with ID starting with 7e1d99d6065ae43209c4aecb972759744369a4132bf59900db6aa964e322d9c3 not found: ID does not exist" containerID="7e1d99d6065ae43209c4aecb972759744369a4132bf59900db6aa964e322d9c3"
Jul 28 20:32:59.618285 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:59.618247    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1d99d6065ae43209c4aecb972759744369a4132bf59900db6aa964e322d9c3"} err="failed to get container status \"7e1d99d6065ae43209c4aecb972759744369a4132bf59900db6aa964e322d9c3\": rpc error: code = NotFound desc = could not find container \"7e1d99d6065ae43209c4aecb972759744369a4132bf59900db6aa964e322d9c3\": container with ID starting with 7e1d99d6065ae43209c4aecb972759744369a4132bf59900db6aa964e322d9c3 not found: ID does not exist"
Jul 28 20:32:59.632742 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:59.632717    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"]
Jul 28 20:32:59.638651 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:32:59.638631    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4vrwk"]
Jul 28 20:33:00.295030 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:00.294999    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3a9207a-723f-416a-a92d-84c084a9efe6" path="/var/lib/kubelet/pods/a3a9207a-723f-416a-a92d-84c084a9efe6/volumes"
Jul 28 20:33:03.073470 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.073431    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"]
Jul 28 20:33:03.074006 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.073741    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3a9207a-723f-416a-a92d-84c084a9efe6" containerName="manager"
Jul 28 20:33:03.074006 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.073752    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3a9207a-723f-416a-a92d-84c084a9efe6" containerName="manager"
Jul 28 20:33:03.074006 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.073777    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8176cd2-ccb9-478f-87ff-c8eeab2fe347" containerName="manager"
Jul 28 20:33:03.074006 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.073784    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8176cd2-ccb9-478f-87ff-c8eeab2fe347" containerName="manager"
Jul 28 20:33:03.074006 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.073847    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8176cd2-ccb9-478f-87ff-c8eeab2fe347" containerName="manager"
Jul 28 20:33:03.074006 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.073858    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3a9207a-723f-416a-a92d-84c084a9efe6" containerName="manager"
Jul 28 20:33:03.076850 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.076830    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.079074 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.079047    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fccd2\""
Jul 28 20:33:03.090175 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.090150    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"]
Jul 28 20:33:03.235695 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.235637    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qddfv\" (UniqueName: \"kubernetes.io/projected/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-kube-api-access-qddfv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.235695 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.235706    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.235922 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.235729    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.235922 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.235757    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.235922 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.235833    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.235922 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.235888    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.236094 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.235964    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.236094 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.235989    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.236094 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.236013    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.337162 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.337069    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.337162 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.337108    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.337378 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.337212    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.337378 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.337239    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.337378 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.337266    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.337378 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.337320    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.337378 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.337347    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.337378 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.337372    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.337648 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.337618    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.337648 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.337637    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.337747 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.337686    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qddfv\" (UniqueName: \"kubernetes.io/projected/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-kube-api-access-qddfv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.337806 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.337771    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.337861 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.337817    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.338081 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.338060    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.339705 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.339683    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.339962 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.339926    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.345309 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.345287    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.345773 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.345750    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qddfv\" (UniqueName: \"kubernetes.io/projected/9dc84e0f-6419-4542-bd1d-e6bf84316cb5-kube-api-access-qddfv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-qldzp\" (UID: \"9dc84e0f-6419-4542-bd1d-e6bf84316cb5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.388029 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.387987    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:03.531216 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.531174    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"]
Jul 28 20:33:03.534325 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:33:03.534292    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc84e0f_6419_4542_bd1d_e6bf84316cb5.slice/crio-7035a192ec880abed9a575b617efcab86dbe7cf858b52aefc6c9ff71f3201e19 WatchSource:0}: Error finding container 7035a192ec880abed9a575b617efcab86dbe7cf858b52aefc6c9ff71f3201e19: Status 404 returned error can't find the container with id 7035a192ec880abed9a575b617efcab86dbe7cf858b52aefc6c9ff71f3201e19
Jul 28 20:33:03.536409 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.536378    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:33:03.536513 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.536444    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:33:03.536513 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.536471    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:33:03.630577 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.630544    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp" event={"ID":"9dc84e0f-6419-4542-bd1d-e6bf84316cb5","Type":"ContainerStarted","Data":"0df359cc56bba253b2ccf0f7ec29a4bda24d86159430e044b85f11c5ddf9ac78"}
Jul 28 20:33:03.630746 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.630596    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp" event={"ID":"9dc84e0f-6419-4542-bd1d-e6bf84316cb5","Type":"ContainerStarted","Data":"7035a192ec880abed9a575b617efcab86dbe7cf858b52aefc6c9ff71f3201e19"}
Jul 28 20:33:03.651984 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:03.651918    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp" podStartSLOduration=0.651902688 podStartE2EDuration="651.902688ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:33:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:33:03.650005264 +0000 UTC m=+497.895381967" watchObservedRunningTime="2026-07-28 20:33:03.651902688 +0000 UTC m=+497.897279390"
Jul 28 20:33:04.388228 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:04.388186    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:04.393088 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:04.393059    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:04.635513 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:04.635474    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:04.636442 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:04.636418    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:33:19.806702 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:19.806665    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:33:19.810065 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:19.810042    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"
Jul 28 20:33:19.813256 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:19.813233    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 28 20:33:19.813657 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:19.813641    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 20:33:19.814114 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:19.814099    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 20:33:19.814246 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:19.814227    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qvrsz\""
Jul 28 20:33:19.835765 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:19.835724    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:33:19.864607 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:19.864568    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:33:19.879450 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:19.879407    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94ff04e3-52ac-412e-b428-e80e8d4882a4-config-file\") pod \"limitador-limitador-54d6d988d5-dkqmg\" (UID: \"94ff04e3-52ac-412e-b428-e80e8d4882a4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"
Jul 28 20:33:19.879591 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:19.879502    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mchbh\" (UniqueName: \"kubernetes.io/projected/94ff04e3-52ac-412e-b428-e80e8d4882a4-kube-api-access-mchbh\") pod \"limitador-limitador-54d6d988d5-dkqmg\" (UID: \"94ff04e3-52ac-412e-b428-e80e8d4882a4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"
Jul 28 20:33:19.980471 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:19.980434    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94ff04e3-52ac-412e-b428-e80e8d4882a4-config-file\") pod \"limitador-limitador-54d6d988d5-dkqmg\" (UID: \"94ff04e3-52ac-412e-b428-e80e8d4882a4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"
Jul 28 20:33:19.980681 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:19.980501    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mchbh\" (UniqueName: \"kubernetes.io/projected/94ff04e3-52ac-412e-b428-e80e8d4882a4-kube-api-access-mchbh\") pod \"limitador-limitador-54d6d988d5-dkqmg\" (UID: \"94ff04e3-52ac-412e-b428-e80e8d4882a4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"
Jul 28 20:33:19.981188 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:19.981161    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94ff04e3-52ac-412e-b428-e80e8d4882a4-config-file\") pod \"limitador-limitador-54d6d988d5-dkqmg\" (UID: \"94ff04e3-52ac-412e-b428-e80e8d4882a4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"
Jul 28 20:33:19.991633 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:19.991604    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mchbh\" (UniqueName: \"kubernetes.io/projected/94ff04e3-52ac-412e-b428-e80e8d4882a4-kube-api-access-mchbh\") pod \"limitador-limitador-54d6d988d5-dkqmg\" (UID: \"94ff04e3-52ac-412e-b428-e80e8d4882a4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"
Jul 28 20:33:20.120986 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:20.120947    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"
Jul 28 20:33:20.299703 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:20.299675    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:33:20.302605 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:33:20.302575    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94ff04e3_52ac_412e_b428_e80e8d4882a4.slice/crio-dff85317610bb58201f724901c071d576cdb721093d3fa853d606f43c3c7c41f WatchSource:0}: Error finding container dff85317610bb58201f724901c071d576cdb721093d3fa853d606f43c3c7c41f: Status 404 returned error can't find the container with id dff85317610bb58201f724901c071d576cdb721093d3fa853d606f43c3c7c41f
Jul 28 20:33:20.705249 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:20.705210    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dkqmg" event={"ID":"94ff04e3-52ac-412e-b428-e80e8d4882a4","Type":"ContainerStarted","Data":"dff85317610bb58201f724901c071d576cdb721093d3fa853d606f43c3c7c41f"}
Jul 28 20:33:23.719671 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:23.719634    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dkqmg" event={"ID":"94ff04e3-52ac-412e-b428-e80e8d4882a4","Type":"ContainerStarted","Data":"dc247964fc29ab5987ff8da004633211d93e1649bd7c6c4ed54528fd1981a4b1"}
Jul 28 20:33:23.720123 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:23.719724    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"
Jul 28 20:33:23.739782 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:23.739738    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-dkqmg" podStartSLOduration=2.277361376 podStartE2EDuration="4.739723329s" totalImagesPullingTime="2.462361953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:33:23.738729148 +0000 UTC m=+517.984105850" watchObservedRunningTime="2026-07-28 20:33:23.739723329 +0000 UTC m=+517.985100030"
Jul 28 20:33:34.725250 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:33:34.725211    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"
Jul 28 20:34:34.272732 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.272700    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:34:34.306674 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.306644    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-ddg9m"]
Jul 28 20:34:34.313271 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.313235    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ddg9m"
Jul 28 20:34:34.317810 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.317776    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-ktvgp"]
Jul 28 20:34:34.317810 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.317802    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 28 20:34:34.318030 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.317802    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-86hqr\""
Jul 28 20:34:34.321468 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.321319    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-ktvgp"
Jul 28 20:34:34.333012 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.332986    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-ktvgp"]
Jul 28 20:34:34.338409 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.338387    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-ddg9m"]
Jul 28 20:34:34.417423 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.417387    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htr4c\" (UniqueName: \"kubernetes.io/projected/c44c1507-f888-4d1c-8437-6c796bf17ee9-kube-api-access-htr4c\") pod \"payload-pre-processing-687dbb6cf6-ddg9m\" (UID: \"c44c1507-f888-4d1c-8437-6c796bf17ee9\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ddg9m"
Jul 28 20:34:34.417617 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.417475    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a4b796a-f666-4783-bfbf-3b83ecf959c7-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-ktvgp\" (UID: \"0a4b796a-f666-4783-bfbf-3b83ecf959c7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-ktvgp"
Jul 28 20:34:34.417617 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.417534    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c44c1507-f888-4d1c-8437-6c796bf17ee9-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-ddg9m\" (UID: \"c44c1507-f888-4d1c-8437-6c796bf17ee9\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ddg9m"
Jul 28 20:34:34.417744 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.417665    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfgp6\" (UniqueName: \"kubernetes.io/projected/0a4b796a-f666-4783-bfbf-3b83ecf959c7-kube-api-access-qfgp6\") pod \"payload-processing-5cc6cd444b-ktvgp\" (UID: \"0a4b796a-f666-4783-bfbf-3b83ecf959c7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-ktvgp"
Jul 28 20:34:34.519089 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.519054    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a4b796a-f666-4783-bfbf-3b83ecf959c7-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-ktvgp\" (UID: \"0a4b796a-f666-4783-bfbf-3b83ecf959c7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-ktvgp"
Jul 28 20:34:34.519272 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.519104    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c44c1507-f888-4d1c-8437-6c796bf17ee9-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-ddg9m\" (UID: \"c44c1507-f888-4d1c-8437-6c796bf17ee9\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ddg9m"
Jul 28 20:34:34.519272 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.519146    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfgp6\" (UniqueName: \"kubernetes.io/projected/0a4b796a-f666-4783-bfbf-3b83ecf959c7-kube-api-access-qfgp6\") pod \"payload-processing-5cc6cd444b-ktvgp\" (UID: \"0a4b796a-f666-4783-bfbf-3b83ecf959c7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-ktvgp"
Jul 28 20:34:34.519272 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.519171    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htr4c\" (UniqueName: \"kubernetes.io/projected/c44c1507-f888-4d1c-8437-6c796bf17ee9-kube-api-access-htr4c\") pod \"payload-pre-processing-687dbb6cf6-ddg9m\" (UID: \"c44c1507-f888-4d1c-8437-6c796bf17ee9\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ddg9m"
Jul 28 20:34:34.519888 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.519865    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a4b796a-f666-4783-bfbf-3b83ecf959c7-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-ktvgp\" (UID: \"0a4b796a-f666-4783-bfbf-3b83ecf959c7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-ktvgp"
Jul 28 20:34:34.519973 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.519868    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c44c1507-f888-4d1c-8437-6c796bf17ee9-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-ddg9m\" (UID: \"c44c1507-f888-4d1c-8437-6c796bf17ee9\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ddg9m"
Jul 28 20:34:34.527790 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.527738    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfgp6\" (UniqueName: \"kubernetes.io/projected/0a4b796a-f666-4783-bfbf-3b83ecf959c7-kube-api-access-qfgp6\") pod \"payload-processing-5cc6cd444b-ktvgp\" (UID: \"0a4b796a-f666-4783-bfbf-3b83ecf959c7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-ktvgp"
Jul 28 20:34:34.528003 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.527985    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htr4c\" (UniqueName: \"kubernetes.io/projected/c44c1507-f888-4d1c-8437-6c796bf17ee9-kube-api-access-htr4c\") pod \"payload-pre-processing-687dbb6cf6-ddg9m\" (UID: \"c44c1507-f888-4d1c-8437-6c796bf17ee9\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ddg9m"
Jul 28 20:34:34.625599 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.625560    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ddg9m"
Jul 28 20:34:34.632660 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.632638    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-ktvgp"
Jul 28 20:34:34.794814 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.794717    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-ddg9m"]
Jul 28 20:34:34.797758 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:34:34.797731    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc44c1507_f888_4d1c_8437_6c796bf17ee9.slice/crio-656f9bde5890982ea3cc53f89cdf6f7a5084f8edbe4779ad7f389d3ec0ed43bc WatchSource:0}: Error finding container 656f9bde5890982ea3cc53f89cdf6f7a5084f8edbe4779ad7f389d3ec0ed43bc: Status 404 returned error can't find the container with id 656f9bde5890982ea3cc53f89cdf6f7a5084f8edbe4779ad7f389d3ec0ed43bc
Jul 28 20:34:34.828956 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:34.828224    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-ktvgp"]
Jul 28 20:34:34.833224 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:34:34.833194    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a4b796a_f666_4783_bfbf_3b83ecf959c7.slice/crio-20525fea8bebb1d41525051cce50eec57ef3b08d6bd638af19e22550e4401ed8 WatchSource:0}: Error finding container 20525fea8bebb1d41525051cce50eec57ef3b08d6bd638af19e22550e4401ed8: Status 404 returned error can't find the container with id 20525fea8bebb1d41525051cce50eec57ef3b08d6bd638af19e22550e4401ed8
Jul 28 20:34:35.030080 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:35.030038    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-ktvgp" event={"ID":"0a4b796a-f666-4783-bfbf-3b83ecf959c7","Type":"ContainerStarted","Data":"20525fea8bebb1d41525051cce50eec57ef3b08d6bd638af19e22550e4401ed8"}
Jul 28 20:34:35.031248 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:35.031213    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ddg9m" event={"ID":"c44c1507-f888-4d1c-8437-6c796bf17ee9","Type":"ContainerStarted","Data":"656f9bde5890982ea3cc53f89cdf6f7a5084f8edbe4779ad7f389d3ec0ed43bc"}
Jul 28 20:34:38.053208 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:38.053134    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-ktvgp" event={"ID":"0a4b796a-f666-4783-bfbf-3b83ecf959c7","Type":"ContainerStarted","Data":"7358ab1753d0e88f6bc52b8350179262e6b54417f980256c954e02220bfc34d8"}
Jul 28 20:34:38.053600 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:38.053310    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-ktvgp"
Jul 28 20:34:38.054700 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:38.054675    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ddg9m" event={"ID":"c44c1507-f888-4d1c-8437-6c796bf17ee9","Type":"ContainerStarted","Data":"cbf50ce9e1e14c258254ed72bdcfe0f526b68ce5f46b44fd52d40880b845de77"}
Jul 28 20:34:38.054783 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:38.054736    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ddg9m"
Jul 28 20:34:38.072490 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:38.072447    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-ktvgp" podStartSLOduration=1.118390684 podStartE2EDuration="4.07243446s" totalImagesPullingTime="2.954043776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:34:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:34:38.071361604 +0000 UTC m=+592.316738307" watchObservedRunningTime="2026-07-28 20:34:38.07243446 +0000 UTC m=+592.317811140"
Jul 28 20:34:42.076089 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:42.076056    2555 generic.go:356] "Generic (PLEG): container finished" podID="9dc84e0f-6419-4542-bd1d-e6bf84316cb5" containerID="0df359cc56bba253b2ccf0f7ec29a4bda24d86159430e044b85f11c5ddf9ac78" exitCode=0
Jul 28 20:34:42.076514 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:42.076133    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp" event={"ID":"9dc84e0f-6419-4542-bd1d-e6bf84316cb5","Type":"ContainerDied","Data":"0df359cc56bba253b2ccf0f7ec29a4bda24d86159430e044b85f11c5ddf9ac78"}
Jul 28 20:34:42.076557 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:42.076520    2555 scope.go:117] "RemoveContainer" containerID="0df359cc56bba253b2ccf0f7ec29a4bda24d86159430e044b85f11c5ddf9ac78"
Jul 28 20:34:42.077473 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:42.077442    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:34:42.077577 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:42.077510    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:34:42.077577 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:42.077541    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:34:42.098402 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:42.098354    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ddg9m" podStartSLOduration=5.10387894 podStartE2EDuration="8.098338495s" totalImagesPullingTime="2.994459555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:34:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:34:38.088268903 +0000 UTC m=+592.333645604" watchObservedRunningTime="2026-07-28 20:34:42.098338495 +0000 UTC m=+596.343715175"
Jul 28 20:34:43.084505 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:43.084473    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp" event={"ID":"9dc84e0f-6419-4542-bd1d-e6bf84316cb5","Type":"ContainerStarted","Data":"0f80d76afef02f70c4a406ada84e56d131ebb24ba71a358daf61bdad6a20708e"}
Jul 28 20:34:43.388780 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:43.388689    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:34:43.389361 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:43.389337    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-qldzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 28 20:34:43.389428 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:43.389386    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp" podUID="9dc84e0f-6419-4542-bd1d-e6bf84316cb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 28 20:34:44.388624 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:44.388581    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-qldzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 28 20:34:44.389077 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:44.388645    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp" podUID="9dc84e0f-6419-4542-bd1d-e6bf84316cb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 28 20:34:45.388635 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:45.388597    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-qldzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 28 20:34:45.389096 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:45.388656    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp" podUID="9dc84e0f-6419-4542-bd1d-e6bf84316cb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 28 20:34:46.232664 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:46.232632    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:34:46.239833 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:46.239806    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:34:46.389367 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:46.389332    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-qldzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 28 20:34:46.389744 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:46.389388    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp" podUID="9dc84e0f-6419-4542-bd1d-e6bf84316cb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 28 20:34:47.392991 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:47.392954    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:34:47.393380 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:47.393320    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:34:47.394050 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:47.394031    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qldzp"
Jul 28 20:34:49.062465 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:49.062429    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-ktvgp"
Jul 28 20:34:49.062912 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:49.062501    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ddg9m"
Jul 28 20:34:50.421510 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:50.421472    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:34:57.708389 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:34:57.708350    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:35:01.395406 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.395371    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"]
Jul 28 20:35:01.402544 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.402515    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.404942 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.404900    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 20:35:01.405063 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.404985    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 20:35:01.405800 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.405784    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sx8kt\""
Jul 28 20:35:01.405858 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.405841    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 28 20:35:01.411703 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.411678    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"]
Jul 28 20:35:01.568337 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.568295    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56e31a77-af91-49b3-b321-247e0d34e732-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.568337 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.568338    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56e31a77-af91-49b3-b321-247e0d34e732-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.568588 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.568395    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56e31a77-af91-49b3-b321-247e0d34e732-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.568588 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.568453    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56e31a77-af91-49b3-b321-247e0d34e732-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.568588 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.568488    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r58pv\" (UniqueName: \"kubernetes.io/projected/56e31a77-af91-49b3-b321-247e0d34e732-kube-api-access-r58pv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.568588 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.568574    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56e31a77-af91-49b3-b321-247e0d34e732-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.670047 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.669951    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56e31a77-af91-49b3-b321-247e0d34e732-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.670047 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.670004    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56e31a77-af91-49b3-b321-247e0d34e732-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.670047 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.670038    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r58pv\" (UniqueName: \"kubernetes.io/projected/56e31a77-af91-49b3-b321-247e0d34e732-kube-api-access-r58pv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.670323 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.670089    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56e31a77-af91-49b3-b321-247e0d34e732-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.670323 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.670131    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56e31a77-af91-49b3-b321-247e0d34e732-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.670323 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.670153    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56e31a77-af91-49b3-b321-247e0d34e732-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.670475 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.670407    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56e31a77-af91-49b3-b321-247e0d34e732-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.670475 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.670438    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56e31a77-af91-49b3-b321-247e0d34e732-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.670600 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.670580    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56e31a77-af91-49b3-b321-247e0d34e732-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.672415 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.672382    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56e31a77-af91-49b3-b321-247e0d34e732-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.672650 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.672632    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56e31a77-af91-49b3-b321-247e0d34e732-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.679344 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.679321    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r58pv\" (UniqueName: \"kubernetes.io/projected/56e31a77-af91-49b3-b321-247e0d34e732-kube-api-access-r58pv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mqh\" (UID: \"56e31a77-af91-49b3-b321-247e0d34e732\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.713887 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.713855    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:01.850445 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:01.850420    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"]
Jul 28 20:35:01.852708 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:35:01.852668    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e31a77_af91_49b3_b321_247e0d34e732.slice/crio-95869097e39724829bccb71d99ab652973be4621b390a1cf7ac70c21469ff98b WatchSource:0}: Error finding container 95869097e39724829bccb71d99ab652973be4621b390a1cf7ac70c21469ff98b: Status 404 returned error can't find the container with id 95869097e39724829bccb71d99ab652973be4621b390a1cf7ac70c21469ff98b
Jul 28 20:35:02.173443 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:02.173408    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh" event={"ID":"56e31a77-af91-49b3-b321-247e0d34e732","Type":"ContainerStarted","Data":"95869097e39724829bccb71d99ab652973be4621b390a1cf7ac70c21469ff98b"}
Jul 28 20:35:02.704046 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:02.704011    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:35:03.179580 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:03.179546    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh" event={"ID":"56e31a77-af91-49b3-b321-247e0d34e732","Type":"ContainerStarted","Data":"492e5827198ffb32b66cc6d5b29ae94993bbabe1d1d0ee0241732eb811b74331"}
Jul 28 20:35:03.199401 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:03.199354    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh" podStartSLOduration=1.101507658 podStartE2EDuration="2.199337536s" totalImagesPullingTime="1.097829878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:35:03.19762058 +0000 UTC m=+617.442997282" watchObservedRunningTime="2026-07-28 20:35:03.199337536 +0000 UTC m=+617.444714267"
Jul 28 20:35:11.714447 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:11.714359    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:11.714447 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:11.714420    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:11.727107 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:11.727080    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:12.236043 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:12.236015    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mqh"
Jul 28 20:35:13.205956 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:13.205909    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:35:30.899338 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:30.899300    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"]
Jul 28 20:35:30.902726 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:30.902709    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:30.905663 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:30.905639    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 28 20:35:30.915419 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:30.915394    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"]
Jul 28 20:35:31.031273 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.031230    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/654d37df-aa22-471e-9e1d-1e930faa221b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.031448 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.031324    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/654d37df-aa22-471e-9e1d-1e930faa221b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.031448 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.031381    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/654d37df-aa22-471e-9e1d-1e930faa221b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.031448 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.031418    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/654d37df-aa22-471e-9e1d-1e930faa221b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.031448 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.031435    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/654d37df-aa22-471e-9e1d-1e930faa221b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.031600 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.031494    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ztvv\" (UniqueName: \"kubernetes.io/projected/654d37df-aa22-471e-9e1d-1e930faa221b-kube-api-access-7ztvv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.132359 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.132321    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/654d37df-aa22-471e-9e1d-1e930faa221b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.132537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.132377    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/654d37df-aa22-471e-9e1d-1e930faa221b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.132537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.132409    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/654d37df-aa22-471e-9e1d-1e930faa221b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.132537 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.132523    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/654d37df-aa22-471e-9e1d-1e930faa221b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.132711 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.132565    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/654d37df-aa22-471e-9e1d-1e930faa221b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.132711 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.132621    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ztvv\" (UniqueName: \"kubernetes.io/projected/654d37df-aa22-471e-9e1d-1e930faa221b-kube-api-access-7ztvv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.132795 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.132750    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/654d37df-aa22-471e-9e1d-1e930faa221b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.132830 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.132812    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/654d37df-aa22-471e-9e1d-1e930faa221b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.132952 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.132913    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/654d37df-aa22-471e-9e1d-1e930faa221b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.134701 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.134669    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/654d37df-aa22-471e-9e1d-1e930faa221b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.134970 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.134951    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/654d37df-aa22-471e-9e1d-1e930faa221b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.142519 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.142498    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ztvv\" (UniqueName: \"kubernetes.io/projected/654d37df-aa22-471e-9e1d-1e930faa221b-kube-api-access-7ztvv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cts7s\" (UID: \"654d37df-aa22-471e-9e1d-1e930faa221b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.212439 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.212344    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:31.348689 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.348664    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"]
Jul 28 20:35:31.350899 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:35:31.350863    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654d37df_aa22_471e_9e1d_1e930faa221b.slice/crio-5c896fa225e5f598896bae546879741c0ff8b5fd30d7c6f76d0bfe09fa057d9a WatchSource:0}: Error finding container 5c896fa225e5f598896bae546879741c0ff8b5fd30d7c6f76d0bfe09fa057d9a: Status 404 returned error can't find the container with id 5c896fa225e5f598896bae546879741c0ff8b5fd30d7c6f76d0bfe09fa057d9a
Jul 28 20:35:31.352254 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:31.352234    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:35:32.310035 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:32.310005    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:35:32.315209 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:32.315180    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s" event={"ID":"654d37df-aa22-471e-9e1d-1e930faa221b","Type":"ContainerStarted","Data":"97e256587582cf2fac8dd4124d3f66c4361c815539e6ea536b8a1765c555ecb3"}
Jul 28 20:35:32.315342 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:32.315232    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s" event={"ID":"654d37df-aa22-471e-9e1d-1e930faa221b","Type":"ContainerStarted","Data":"5c896fa225e5f598896bae546879741c0ff8b5fd30d7c6f76d0bfe09fa057d9a"}
Jul 28 20:35:32.336705 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:32.336656    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s" podStartSLOduration=2.008999812 podStartE2EDuration="2.336640245s" totalImagesPullingTime="327.640433ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:35:32.335131514 +0000 UTC m=+646.580508217" watchObservedRunningTime="2026-07-28 20:35:32.336640245 +0000 UTC m=+646.582016947"
Jul 28 20:35:41.213227 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:41.213185    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:41.213810 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:41.213330    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:41.225397 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:41.225375    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:41.369825 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:41.369793    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cts7s"
Jul 28 20:35:50.406657 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.406625    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"]
Jul 28 20:35:50.409981 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.409960    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.412352 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.412331    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 28 20:35:50.420797 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.420776    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"]
Jul 28 20:35:50.508854 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.508822    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.508854 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.508853    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.509061 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.508873    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.509061 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.508954    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.509061 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.508992    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfqs2\" (UniqueName: \"kubernetes.io/projected/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-kube-api-access-vfqs2\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.509061 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.509016    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.610338 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.610296    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.610513 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.610364    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfqs2\" (UniqueName: \"kubernetes.io/projected/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-kube-api-access-vfqs2\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.610513 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.610401    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.610591 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.610504    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.610591 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.610532    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.610591 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.610555    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.610856 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.610834    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.610923 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.610906    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.611000 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.610986    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.612721 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.612697    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.612993 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.612974    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.627745 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.627724    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfqs2\" (UniqueName: \"kubernetes.io/projected/3c9419d7-b694-4c86-b4e6-1eede7fdc3a8-kube-api-access-vfqs2\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5\" (UID: \"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.718982 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.718880    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:35:50.853220 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:50.853193    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"]
Jul 28 20:35:50.855465 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:35:50.855435    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c9419d7_b694_4c86_b4e6_1eede7fdc3a8.slice/crio-22251b955f214473517cf188c60d767c2d6add3b2cf7870f6441eac75e698293 WatchSource:0}: Error finding container 22251b955f214473517cf188c60d767c2d6add3b2cf7870f6441eac75e698293: Status 404 returned error can't find the container with id 22251b955f214473517cf188c60d767c2d6add3b2cf7870f6441eac75e698293
Jul 28 20:35:51.407503 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:51.407463    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5" event={"ID":"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8","Type":"ContainerStarted","Data":"8b17fd0bcfebd0aa3c3d76d49af6d367ff1ef6318371083da738da3aa8c81255"}
Jul 28 20:35:51.407896 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:51.407512    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5" event={"ID":"3c9419d7-b694-4c86-b4e6-1eede7fdc3a8","Type":"ContainerStarted","Data":"22251b955f214473517cf188c60d767c2d6add3b2cf7870f6441eac75e698293"}
Jul 28 20:35:51.426692 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:51.426649    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5" podStartSLOduration=1.226419395 podStartE2EDuration="1.426634924s" totalImagesPullingTime="200.215529ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:35:51.425384995 +0000 UTC m=+665.670761721" watchObservedRunningTime="2026-07-28 20:35:51.426634924 +0000 UTC m=+665.672011626"
Jul 28 20:35:53.308083 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:35:53.308038    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:36:00.719540 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:36:00.719496    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:36:00.719971 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:36:00.719562    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:36:00.731802 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:36:00.731775    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:36:01.465457 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:36:01.465422    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5"
Jul 28 20:37:43.599784 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:37:43.599743    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:37:53.195849 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:37:53.195807    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:38:03.516007 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:38:03.515971    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:39:46.265968 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:39:46.265920    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:39:46.268069 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:39:46.268047    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:39:49.096009 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:39:49.095972    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:39:58.307491 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:39:58.307452    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:40:28.012974 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:40:28.012902    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:40:37.324023 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:40:37.323987    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:40:47.409405 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:40:47.409366    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:40:55.409162 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:40:55.409122    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:41:06.004253 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:41:06.004214    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:41:15.813975 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:41:15.813872    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:41:26.533963 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:41:26.533912    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:41:36.102469 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:41:36.102432    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:41:59.003594 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:41:59.003547    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:42:08.612362 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:42:08.612327    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:42:33.403766 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:42:33.403725    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:42:44.396798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:42:44.396707    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:42:55.496264 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:42:55.496231    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:43:12.806801 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:43:12.806760    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:43:24.400798 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:43:24.400762    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:43:33.708943 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:43:33.708903    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:43:43.512765 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:43:43.512727    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:43:53.113376 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:43:53.109959    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:44:46.299018 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:44:46.298990    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:44:46.301567 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:44:46.298990    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:45:48.507381 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:45:48.507281    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:45:59.899002 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:45:59.898966    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:46:15.516300 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:46:15.516262    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:46:25.106114 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:46:25.106074    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:46:38.213721 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:46:38.213683    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:46:46.407421 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:46:46.407387    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:46:56.206791 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:46:56.206753    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:47:07.232429 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:47:07.232385    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:47:16.813137 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:47:16.813106    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:47:27.935018 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:47:27.934976    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:48:05.237649 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:05.237609    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:48:16.351773 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:16.351737    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:48:33.833799 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:33.833759    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:48:38.493223 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.493140    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"]
Jul 28 20:48:38.496509 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.496488    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.501526 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:48:38.501487    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"e2e-same-id-b-9af4156f-kserve-self-signed-certs\" is forbidden: User \"system:node:ip-10-0-137-26.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-137-26.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"llm\"/\"e2e-same-id-b-9af4156f-kserve-self-signed-certs\"" type="*v1.Secret"
Jul 28 20:48:38.501639 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:48:38.501602    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" is forbidden: User \"system:node:ip-10-0-137-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-137-26.ec2.internal' and this object" podUID="fed67e42-f684-4cd3-ae31-da18c372cc63" pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.569434 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.569399    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"]
Jul 28 20:48:38.636137 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.636099    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-model-cache\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.636317 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.636149    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-home\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.636317 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.636210    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwm8r\" (UniqueName: \"kubernetes.io/projected/fed67e42-f684-4cd3-ae31-da18c372cc63-kube-api-access-kwm8r\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.636317 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.636292    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fed67e42-f684-4cd3-ae31-da18c372cc63-tls-certs\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.636447 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.636352    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-tmp-dir\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.636447 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.636396    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-dshm\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.737854 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.737813    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-model-cache\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.737854 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.737854    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-home\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.738129 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.737876    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwm8r\" (UniqueName: \"kubernetes.io/projected/fed67e42-f684-4cd3-ae31-da18c372cc63-kube-api-access-kwm8r\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.738129 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.737907    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fed67e42-f684-4cd3-ae31-da18c372cc63-tls-certs\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.738129 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.737984    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-tmp-dir\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.738129 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.738029    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-dshm\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.738311 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.738287    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-home\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.738356 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.738302    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-model-cache\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.738485 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.738332    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-tmp-dir\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.744443 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.741059    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-dshm\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:38.753324 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:38.753293    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwm8r\" (UniqueName: \"kubernetes.io/projected/fed67e42-f684-4cd3-ae31-da18c372cc63-kube-api-access-kwm8r\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:39.617188 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:39.617154    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-9af4156f-kserve-self-signed-certs\""
Jul 28 20:48:39.620631 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:39.620604    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fed67e42-f684-4cd3-ae31-da18c372cc63-tls-certs\") pod \"e2e-same-id-b-9af4156f-kserve-f489d795-4srh9\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") " pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:39.705446 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:39.705405    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:39.871871 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:48:39.871838    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfed67e42_f684_4cd3_ae31_da18c372cc63.slice/crio-bd717ea827f4b2fc20059b5e612ccd49c774300cb6f3f8495c71035ec16473a3 WatchSource:0}: Error finding container bd717ea827f4b2fc20059b5e612ccd49c774300cb6f3f8495c71035ec16473a3: Status 404 returned error can't find the container with id bd717ea827f4b2fc20059b5e612ccd49c774300cb6f3f8495c71035ec16473a3
Jul 28 20:48:39.872344 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:39.872323    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"]
Jul 28 20:48:39.933807 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:39.933773    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9" event={"ID":"fed67e42-f684-4cd3-ae31-da18c372cc63","Type":"ContainerStarted","Data":"bd717ea827f4b2fc20059b5e612ccd49c774300cb6f3f8495c71035ec16473a3"}
Jul 28 20:48:40.939972 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:40.939916    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9" event={"ID":"fed67e42-f684-4cd3-ae31-da18c372cc63","Type":"ContainerStarted","Data":"4baae36229398e48a2bce566d45c37d9c566cd699824797cccdeb50513bc61b0"}
Jul 28 20:48:40.984037 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:40.983981    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9" podStartSLOduration=2.983961614 podStartE2EDuration="2.983961614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:48:40.983173684 +0000 UTC m=+1435.228550385" watchObservedRunningTime="2026-07-28 20:48:40.983961614 +0000 UTC m=+1435.229338315"
Jul 28 20:48:44.730942 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:44.730899    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:48:49.706168 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:49.706130    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:49.706661 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:49.706196    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:49.719368 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:49.719339    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:48:49.993511 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:48:49.993424    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:49:02.084230 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:02.084196    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"]
Jul 28 20:49:04.816509 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:04.816472    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:49:17.103377 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.103308    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9" podUID="fed67e42-f684-4cd3-ae31-da18c372cc63" containerName="main" containerID="cri-o://4baae36229398e48a2bce566d45c37d9c566cd699824797cccdeb50513bc61b0" gracePeriod=45
Jul 28 20:49:17.364093 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.364027    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:49:17.496052 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.496012    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-model-cache\") pod \"fed67e42-f684-4cd3-ae31-da18c372cc63\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") "
Jul 28 20:49:17.496239 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.496070    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwm8r\" (UniqueName: \"kubernetes.io/projected/fed67e42-f684-4cd3-ae31-da18c372cc63-kube-api-access-kwm8r\") pod \"fed67e42-f684-4cd3-ae31-da18c372cc63\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") "
Jul 28 20:49:17.496239 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.496137    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-home\") pod \"fed67e42-f684-4cd3-ae31-da18c372cc63\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") "
Jul 28 20:49:17.496239 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.496196    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-tmp-dir\") pod \"fed67e42-f684-4cd3-ae31-da18c372cc63\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") "
Jul 28 20:49:17.496239 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.496219    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-dshm\") pod \"fed67e42-f684-4cd3-ae31-da18c372cc63\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") "
Jul 28 20:49:17.496462 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.496276    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fed67e42-f684-4cd3-ae31-da18c372cc63-tls-certs\") pod \"fed67e42-f684-4cd3-ae31-da18c372cc63\" (UID: \"fed67e42-f684-4cd3-ae31-da18c372cc63\") "
Jul 28 20:49:17.496462 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.496354    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-model-cache" (OuterVolumeSpecName: "model-cache") pod "fed67e42-f684-4cd3-ae31-da18c372cc63" (UID: "fed67e42-f684-4cd3-ae31-da18c372cc63"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:17.496462 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.496420    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-home" (OuterVolumeSpecName: "home") pod "fed67e42-f684-4cd3-ae31-da18c372cc63" (UID: "fed67e42-f684-4cd3-ae31-da18c372cc63"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:17.496589 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.496458    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fed67e42-f684-4cd3-ae31-da18c372cc63" (UID: "fed67e42-f684-4cd3-ae31-da18c372cc63"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:17.496625 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.496586    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-tmp-dir\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:49:17.496625 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.496600    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-model-cache\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:49:17.496735 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.496645    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-home\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:49:17.498469 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.498441    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fed67e42-f684-4cd3-ae31-da18c372cc63-kube-api-access-kwm8r" (OuterVolumeSpecName: "kube-api-access-kwm8r") pod "fed67e42-f684-4cd3-ae31-da18c372cc63" (UID: "fed67e42-f684-4cd3-ae31-da18c372cc63"). InnerVolumeSpecName "kube-api-access-kwm8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:49:17.498577 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.498476    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-dshm" (OuterVolumeSpecName: "dshm") pod "fed67e42-f684-4cd3-ae31-da18c372cc63" (UID: "fed67e42-f684-4cd3-ae31-da18c372cc63"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:17.498577 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.498494    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fed67e42-f684-4cd3-ae31-da18c372cc63-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fed67e42-f684-4cd3-ae31-da18c372cc63" (UID: "fed67e42-f684-4cd3-ae31-da18c372cc63"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:49:17.597431 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.597385    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fed67e42-f684-4cd3-ae31-da18c372cc63-dshm\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:49:17.597431 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.597426    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fed67e42-f684-4cd3-ae31-da18c372cc63-tls-certs\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:49:17.597431 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:17.597441    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwm8r\" (UniqueName: \"kubernetes.io/projected/fed67e42-f684-4cd3-ae31-da18c372cc63-kube-api-access-kwm8r\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:49:18.118144 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:18.118104    2555 generic.go:356] "Generic (PLEG): container finished" podID="fed67e42-f684-4cd3-ae31-da18c372cc63" containerID="4baae36229398e48a2bce566d45c37d9c566cd699824797cccdeb50513bc61b0" exitCode=0
Jul 28 20:49:18.118571 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:18.118161    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"
Jul 28 20:49:18.118571 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:18.118194    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9" event={"ID":"fed67e42-f684-4cd3-ae31-da18c372cc63","Type":"ContainerDied","Data":"4baae36229398e48a2bce566d45c37d9c566cd699824797cccdeb50513bc61b0"}
Jul 28 20:49:18.118571 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:18.118241    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9" event={"ID":"fed67e42-f684-4cd3-ae31-da18c372cc63","Type":"ContainerDied","Data":"bd717ea827f4b2fc20059b5e612ccd49c774300cb6f3f8495c71035ec16473a3"}
Jul 28 20:49:18.118571 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:18.118258    2555 scope.go:117] "RemoveContainer" containerID="4baae36229398e48a2bce566d45c37d9c566cd699824797cccdeb50513bc61b0"
Jul 28 20:49:18.127688 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:18.127672    2555 scope.go:117] "RemoveContainer" containerID="4baae36229398e48a2bce566d45c37d9c566cd699824797cccdeb50513bc61b0"
Jul 28 20:49:18.127963 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:49:18.127921    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4baae36229398e48a2bce566d45c37d9c566cd699824797cccdeb50513bc61b0\": container with ID starting with 4baae36229398e48a2bce566d45c37d9c566cd699824797cccdeb50513bc61b0 not found: ID does not exist" containerID="4baae36229398e48a2bce566d45c37d9c566cd699824797cccdeb50513bc61b0"
Jul 28 20:49:18.128034 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:18.127967    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4baae36229398e48a2bce566d45c37d9c566cd699824797cccdeb50513bc61b0"} err="failed to get container status \"4baae36229398e48a2bce566d45c37d9c566cd699824797cccdeb50513bc61b0\": rpc error: code = NotFound desc = could not find container \"4baae36229398e48a2bce566d45c37d9c566cd699824797cccdeb50513bc61b0\": container with ID starting with 4baae36229398e48a2bce566d45c37d9c566cd699824797cccdeb50513bc61b0 not found: ID does not exist"
Jul 28 20:49:18.149187 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:18.149148    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"]
Jul 28 20:49:18.157592 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:18.157561    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-9af4156f-kserve-f489d795-4srh9"]
Jul 28 20:49:18.295922 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:18.295888    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fed67e42-f684-4cd3-ae31-da18c372cc63" path="/var/lib/kubelet/pods/fed67e42-f684-4cd3-ae31-da18c372cc63/volumes"
Jul 28 20:49:18.720177 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:18.720139    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:49:25.408992 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:25.408957    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:49:42.125431 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:42.125384    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:49:46.325924 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:46.325895    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:49:46.328360 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:46.328034    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:49:54.115729 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:49:54.115691    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:50:04.257605 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:50:04.257566    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:50:12.710007 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:50:12.709904    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:50:22.634669 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:50:22.634633    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:50:32.605052 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:50:32.605012    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:50:46.217807 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:50:46.217763    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:50:55.510830 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:50:55.510787    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:51:10.701821 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:51:10.701784    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:51:20.205768 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:51:20.205731    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:51:32.203662 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:51:32.203628    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:51:48.106838 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:51:48.106753    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:51:59.805182 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:51:59.805145    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:52:12.317790 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:12.317753    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:52:20.704825 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:20.704781    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:52:29.623868 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:29.623832    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:52:52.109830 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:52.109787    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:52:59.024399 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.024362    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"]
Jul 28 20:52:59.024792 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.024729    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fed67e42-f684-4cd3-ae31-da18c372cc63" containerName="main"
Jul 28 20:52:59.024792 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.024740    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="fed67e42-f684-4cd3-ae31-da18c372cc63" containerName="main"
Jul 28 20:52:59.024867 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.024814    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="fed67e42-f684-4cd3-ae31-da18c372cc63" containerName="main"
Jul 28 20:52:59.027773 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.027756    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.032819 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.032793    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2545433a-openshift-default-dockercfg-thllv\""
Jul 28 20:52:59.069180 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.069102    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-credential-socket\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.069180 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.069153    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-token\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.069391 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.069244    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxv2m\" (UniqueName: \"kubernetes.io/projected/aa9fa631-6724-4ad2-931f-0ac58a5942e7-kube-api-access-fxv2m\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.069391 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.069293    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-data\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.069391 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.069354    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-podinfo\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.069391 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.069388    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-workload-socket\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.069573 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.069426    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istiod-ca-cert\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.069573 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.069468    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-workload-certs\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.069573 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.069516    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-envoy\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.081218 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.081181    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"]
Jul 28 20:52:59.170644 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.170609    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-podinfo\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.170644 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.170648    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-workload-socket\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.170909 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.170668    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istiod-ca-cert\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.170909 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.170695    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-workload-certs\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.170909 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.170735    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-envoy\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.170909 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.170786    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-credential-socket\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.170909 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.170819    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-token\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.170909 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.170853    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxv2m\" (UniqueName: \"kubernetes.io/projected/aa9fa631-6724-4ad2-931f-0ac58a5942e7-kube-api-access-fxv2m\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.170909 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.170887    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-data\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.171438 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.171132    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-workload-socket\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.171438 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.171198    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-workload-certs\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.171546 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.171467    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istiod-ca-cert\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.171546 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.171468    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-credential-socket\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.171649 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.171608    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-data\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.173212 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.173184    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-envoy\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.173901 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.173864    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-podinfo\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.184052 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.184025    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxv2m\" (UniqueName: \"kubernetes.io/projected/aa9fa631-6724-4ad2-931f-0ac58a5942e7-kube-api-access-fxv2m\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.184183 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.184162    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-token\") pod \"e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") " pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.338856 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.338819    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:52:59.478397 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.478252    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"]
Jul 28 20:52:59.481404 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:52:59.481369    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa9fa631_6724_4ad2_931f_0ac58a5942e7.slice/crio-80fb4b553dd3db6fa9cb5815b35dab593daecd8a3efabb710f2cd4cc4f1ebab1 WatchSource:0}: Error finding container 80fb4b553dd3db6fa9cb5815b35dab593daecd8a3efabb710f2cd4cc4f1ebab1: Status 404 returned error can't find the container with id 80fb4b553dd3db6fa9cb5815b35dab593daecd8a3efabb710f2cd4cc4f1ebab1
Jul 28 20:52:59.483477 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.483444    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:52:59.483562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.483508    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:52:59.483562 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:52:59.483536    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:53:00.166559 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:00.166526    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9" event={"ID":"aa9fa631-6724-4ad2-931f-0ac58a5942e7","Type":"ContainerStarted","Data":"553ed7e91aab25fefac48da010731b0a6ce3397706423d74afdce32f68d417b8"}
Jul 28 20:53:00.166994 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:00.166579    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9" event={"ID":"aa9fa631-6724-4ad2-931f-0ac58a5942e7","Type":"ContainerStarted","Data":"80fb4b553dd3db6fa9cb5815b35dab593daecd8a3efabb710f2cd4cc4f1ebab1"}
Jul 28 20:53:00.190802 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:00.190753    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9" podStartSLOduration=2.190738824 podStartE2EDuration="2.190738824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:53:00.189909656 +0000 UTC m=+1694.435286359" watchObservedRunningTime="2026-07-28 20:53:00.190738824 +0000 UTC m=+1694.436115525"
Jul 28 20:53:00.339273 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:00.339235    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:53:00.344174 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:00.344148    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:53:01.171591 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:01.171557    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:53:01.172500 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:01.172480    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:53:02.965547 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:02.965512    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"]
Jul 28 20:53:02.968902 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:02.968881    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"
Jul 28 20:53:02.972360 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:02.972339    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-2545433a-dockercfg-pthqv\""
Jul 28 20:53:02.972620 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:02.972600    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-2545433a\""
Jul 28 20:53:02.987568 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:02.987545    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"]
Jul 28 20:53:03.003816 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:03.003791    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7-plugins-config-volume\") pod \"payload-processing-e2e-ait-2545433a-85df74895d-f6v8k\" (UID: \"b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7\") " pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"
Jul 28 20:53:03.003964 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:03.003825    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6rmt\" (UniqueName: \"kubernetes.io/projected/b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7-kube-api-access-z6rmt\") pod \"payload-processing-e2e-ait-2545433a-85df74895d-f6v8k\" (UID: \"b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7\") " pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"
Jul 28 20:53:03.104898 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:03.104847    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7-plugins-config-volume\") pod \"payload-processing-e2e-ait-2545433a-85df74895d-f6v8k\" (UID: \"b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7\") " pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"
Jul 28 20:53:03.104898 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:03.104900    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6rmt\" (UniqueName: \"kubernetes.io/projected/b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7-kube-api-access-z6rmt\") pod \"payload-processing-e2e-ait-2545433a-85df74895d-f6v8k\" (UID: \"b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7\") " pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"
Jul 28 20:53:03.105678 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:03.105655    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7-plugins-config-volume\") pod \"payload-processing-e2e-ait-2545433a-85df74895d-f6v8k\" (UID: \"b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7\") " pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"
Jul 28 20:53:03.132055 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:03.132026    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6rmt\" (UniqueName: \"kubernetes.io/projected/b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7-kube-api-access-z6rmt\") pod \"payload-processing-e2e-ait-2545433a-85df74895d-f6v8k\" (UID: \"b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7\") " pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"
Jul 28 20:53:03.279838 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:03.279749    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"
Jul 28 20:53:03.420986 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:03.420961    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"]
Jul 28 20:53:03.422790 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:53:03.422760    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d1b9fb_6cf7_4602_b8b2_bc10cdf7b5c7.slice/crio-5c87c2897c3fa833a89cbaeb5ea4373fdf542fc64c836bc9273701a67148166c WatchSource:0}: Error finding container 5c87c2897c3fa833a89cbaeb5ea4373fdf542fc64c836bc9273701a67148166c: Status 404 returned error can't find the container with id 5c87c2897c3fa833a89cbaeb5ea4373fdf542fc64c836bc9273701a67148166c
Jul 28 20:53:04.187662 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:04.187621    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k" event={"ID":"b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7","Type":"ContainerStarted","Data":"887f1c74a25de4c46094652264f21b0ebb798c4b0d82160941e34bdb59f48508"}
Jul 28 20:53:04.188154 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:04.187705    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k" event={"ID":"b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7","Type":"ContainerStarted","Data":"5c87c2897c3fa833a89cbaeb5ea4373fdf542fc64c836bc9273701a67148166c"}
Jul 28 20:53:04.188154 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:04.187740    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"
Jul 28 20:53:09.499181 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:09.499123    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k" podStartSLOduration=7.499103494 podStartE2EDuration="7.499103494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:53:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:53:04.22790022 +0000 UTC m=+1698.473276923" watchObservedRunningTime="2026-07-28 20:53:09.499103494 +0000 UTC m=+1703.744480243"
Jul 28 20:53:09.500701 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:09.500680    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:53:15.194567 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:15.194531    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"
Jul 28 20:53:17.213120 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:17.213073    2555 patch_prober.go:28] interesting pod/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 20:53:17.213488 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:17.213156    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9" podUID="aa9fa631-6724-4ad2-931f-0ac58a5942e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 20:53:18.265605 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:18.265568    2555 generic.go:356] "Generic (PLEG): container finished" podID="aa9fa631-6724-4ad2-931f-0ac58a5942e7" containerID="553ed7e91aab25fefac48da010731b0a6ce3397706423d74afdce32f68d417b8" exitCode=0
Jul 28 20:53:18.266094 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:18.265644    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9" event={"ID":"aa9fa631-6724-4ad2-931f-0ac58a5942e7","Type":"ContainerDied","Data":"553ed7e91aab25fefac48da010731b0a6ce3397706423d74afdce32f68d417b8"}
Jul 28 20:53:18.266161 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:18.266139    2555 scope.go:117] "RemoveContainer" containerID="553ed7e91aab25fefac48da010731b0a6ce3397706423d74afdce32f68d417b8"
Jul 28 20:53:18.267206 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:18.267179    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:53:18.267274 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:18.267261    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:53:18.267331 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:18.267304    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:53:19.273474 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:19.273441    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9" event={"ID":"aa9fa631-6724-4ad2-931f-0ac58a5942e7","Type":"ContainerStarted","Data":"3ad6664545f84b7b7a334b18cc78a64c1fdc1502c4657c9debc21d1c0739e9de"}
Jul 28 20:53:19.339540 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:19.339495    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:53:19.339821 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:19.339795    2555 patch_prober.go:28] interesting pod/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 28 20:53:19.339915 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:19.339852    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9" podUID="aa9fa631-6724-4ad2-931f-0ac58a5942e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 28 20:53:20.340290 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:20.340248    2555 patch_prober.go:28] interesting pod/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 28 20:53:20.340694 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:20.340333    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9" podUID="aa9fa631-6724-4ad2-931f-0ac58a5942e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 28 20:53:21.340321 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:21.340278    2555 patch_prober.go:28] interesting pod/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 28 20:53:21.340744 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:21.340358    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9" podUID="aa9fa631-6724-4ad2-931f-0ac58a5942e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 28 20:53:22.339842 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:22.339802    2555 patch_prober.go:28] interesting pod/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 28 20:53:22.340064 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:22.339874    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9" podUID="aa9fa631-6724-4ad2-931f-0ac58a5942e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 28 20:53:23.339428 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:23.339385    2555 patch_prober.go:28] interesting pod/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 28 20:53:23.339957 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:23.339457    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9" podUID="aa9fa631-6724-4ad2-931f-0ac58a5942e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 28 20:53:24.343384 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:24.343354    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:53:24.343777 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:24.343608    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:53:24.344203 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:24.344188    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:53:32.485403 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:32.485372    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"]
Jul 28 20:53:32.485849 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:32.485576    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k" podUID="b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7" containerName="payload-processing" containerID="cri-o://887f1c74a25de4c46094652264f21b0ebb798c4b0d82160941e34bdb59f48508" gracePeriod=30
Jul 28 20:53:32.747274 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:32.747220    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"
Jul 28 20:53:32.800153 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:32.800120    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"]
Jul 28 20:53:32.800404 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:32.800372    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9" podUID="aa9fa631-6724-4ad2-931f-0ac58a5942e7" containerName="istio-proxy" containerID="cri-o://3ad6664545f84b7b7a334b18cc78a64c1fdc1502c4657c9debc21d1c0739e9de" gracePeriod=30
Jul 28 20:53:32.887290 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:32.887256    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7-plugins-config-volume\") pod \"b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7\" (UID: \"b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7\") "
Jul 28 20:53:32.887502 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:32.887309    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6rmt\" (UniqueName: \"kubernetes.io/projected/b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7-kube-api-access-z6rmt\") pod \"b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7\" (UID: \"b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7\") "
Jul 28 20:53:32.887617 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:32.887595    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7" (UID: "b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:53:32.889465 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:32.889442    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7-kube-api-access-z6rmt" (OuterVolumeSpecName: "kube-api-access-z6rmt") pod "b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7" (UID: "b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7"). InnerVolumeSpecName "kube-api-access-z6rmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:53:32.987978 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:32.987913    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:53:32.987978 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:32.987972    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6rmt\" (UniqueName: \"kubernetes.io/projected/b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7-kube-api-access-z6rmt\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:53:33.340357 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:33.340320    2555 generic.go:356] "Generic (PLEG): container finished" podID="b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7" containerID="887f1c74a25de4c46094652264f21b0ebb798c4b0d82160941e34bdb59f48508" exitCode=0
Jul 28 20:53:33.340357 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:33.340359    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"
Jul 28 20:53:33.340580 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:33.340402    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k" event={"ID":"b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7","Type":"ContainerDied","Data":"887f1c74a25de4c46094652264f21b0ebb798c4b0d82160941e34bdb59f48508"}
Jul 28 20:53:33.340580 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:33.340461    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k" event={"ID":"b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7","Type":"ContainerDied","Data":"5c87c2897c3fa833a89cbaeb5ea4373fdf542fc64c836bc9273701a67148166c"}
Jul 28 20:53:33.340580 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:33.340487    2555 scope.go:117] "RemoveContainer" containerID="887f1c74a25de4c46094652264f21b0ebb798c4b0d82160941e34bdb59f48508"
Jul 28 20:53:33.349424 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:33.349407    2555 scope.go:117] "RemoveContainer" containerID="887f1c74a25de4c46094652264f21b0ebb798c4b0d82160941e34bdb59f48508"
Jul 28 20:53:33.349702 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:53:33.349678    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"887f1c74a25de4c46094652264f21b0ebb798c4b0d82160941e34bdb59f48508\": container with ID starting with 887f1c74a25de4c46094652264f21b0ebb798c4b0d82160941e34bdb59f48508 not found: ID does not exist" containerID="887f1c74a25de4c46094652264f21b0ebb798c4b0d82160941e34bdb59f48508"
Jul 28 20:53:33.349750 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:33.349714    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"887f1c74a25de4c46094652264f21b0ebb798c4b0d82160941e34bdb59f48508"} err="failed to get container status \"887f1c74a25de4c46094652264f21b0ebb798c4b0d82160941e34bdb59f48508\": rpc error: code = NotFound desc = could not find container \"887f1c74a25de4c46094652264f21b0ebb798c4b0d82160941e34bdb59f48508\": container with ID starting with 887f1c74a25de4c46094652264f21b0ebb798c4b0d82160941e34bdb59f48508 not found: ID does not exist"
Jul 28 20:53:33.374969 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:33.374921    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"]
Jul 28 20:53:33.378146 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:33.378121    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2545433a-85df74895d-f6v8k"]
Jul 28 20:53:34.296221 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:34.296187    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7" path="/var/lib/kubelet/pods/b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7/volumes"
Jul 28 20:53:36.517791 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:36.517755    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:53:38.066849 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.066820    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:53:38.236543 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.236504    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-podinfo\") pod \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") "
Jul 28 20:53:38.236727 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.236580    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-credential-socket\") pod \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") "
Jul 28 20:53:38.236727 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.236599    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-token\") pod \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") "
Jul 28 20:53:38.236727 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.236615    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-workload-socket\") pod \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") "
Jul 28 20:53:38.236727 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.236631    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-workload-certs\") pod \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") "
Jul 28 20:53:38.236963 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.236751    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istiod-ca-cert\") pod \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") "
Jul 28 20:53:38.236963 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.236805    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-envoy\") pod \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") "
Jul 28 20:53:38.236963 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.236839    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxv2m\" (UniqueName: \"kubernetes.io/projected/aa9fa631-6724-4ad2-931f-0ac58a5942e7-kube-api-access-fxv2m\") pod \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") "
Jul 28 20:53:38.236963 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.236895    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-data\") pod \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\" (UID: \"aa9fa631-6724-4ad2-931f-0ac58a5942e7\") "
Jul 28 20:53:38.237176 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.236977    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa9fa631-6724-4ad2-931f-0ac58a5942e7" (UID: "aa9fa631-6724-4ad2-931f-0ac58a5942e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:53:38.237176 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.237002    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa9fa631-6724-4ad2-931f-0ac58a5942e7" (UID: "aa9fa631-6724-4ad2-931f-0ac58a5942e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:53:38.237176 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.237016    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa9fa631-6724-4ad2-931f-0ac58a5942e7" (UID: "aa9fa631-6724-4ad2-931f-0ac58a5942e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:53:38.237335 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.237252    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-credential-socket\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:53:38.237335 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.237274    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-workload-socket\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:53:38.237335 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.237288    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-workload-certs\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:53:38.237535 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.237514    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa9fa631-6724-4ad2-931f-0ac58a5942e7" (UID: "aa9fa631-6724-4ad2-931f-0ac58a5942e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:53:38.237890 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.237866    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa9fa631-6724-4ad2-931f-0ac58a5942e7" (UID: "aa9fa631-6724-4ad2-931f-0ac58a5942e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:53:38.238845 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.238816    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa9fa631-6724-4ad2-931f-0ac58a5942e7" (UID: "aa9fa631-6724-4ad2-931f-0ac58a5942e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:53:38.239098 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.239067    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa9fa631-6724-4ad2-931f-0ac58a5942e7-kube-api-access-fxv2m" (OuterVolumeSpecName: "kube-api-access-fxv2m") pod "aa9fa631-6724-4ad2-931f-0ac58a5942e7" (UID: "aa9fa631-6724-4ad2-931f-0ac58a5942e7"). InnerVolumeSpecName "kube-api-access-fxv2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:53:38.239182 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.239131    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa9fa631-6724-4ad2-931f-0ac58a5942e7" (UID: "aa9fa631-6724-4ad2-931f-0ac58a5942e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:53:38.239308 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.239279    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa9fa631-6724-4ad2-931f-0ac58a5942e7" (UID: "aa9fa631-6724-4ad2-931f-0ac58a5942e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:53:38.338388 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.338299    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istiod-ca-cert\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:53:38.338388 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.338332    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-envoy\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:53:38.338388 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.338341    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxv2m\" (UniqueName: \"kubernetes.io/projected/aa9fa631-6724-4ad2-931f-0ac58a5942e7-kube-api-access-fxv2m\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:53:38.338388 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.338351    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-data\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:53:38.338388 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.338360    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-podinfo\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:53:38.338388 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.338368    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa9fa631-6724-4ad2-931f-0ac58a5942e7-istio-token\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:53:38.366874 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.366837    2555 generic.go:356] "Generic (PLEG): container finished" podID="aa9fa631-6724-4ad2-931f-0ac58a5942e7" containerID="3ad6664545f84b7b7a334b18cc78a64c1fdc1502c4657c9debc21d1c0739e9de" exitCode=0
Jul 28 20:53:38.367072 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.366907    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"
Jul 28 20:53:38.367072 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.366925    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9" event={"ID":"aa9fa631-6724-4ad2-931f-0ac58a5942e7","Type":"ContainerDied","Data":"3ad6664545f84b7b7a334b18cc78a64c1fdc1502c4657c9debc21d1c0739e9de"}
Jul 28 20:53:38.367072 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.367014    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9" event={"ID":"aa9fa631-6724-4ad2-931f-0ac58a5942e7","Type":"ContainerDied","Data":"80fb4b553dd3db6fa9cb5815b35dab593daecd8a3efabb710f2cd4cc4f1ebab1"}
Jul 28 20:53:38.367072 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.367037    2555 scope.go:117] "RemoveContainer" containerID="3ad6664545f84b7b7a334b18cc78a64c1fdc1502c4657c9debc21d1c0739e9de"
Jul 28 20:53:38.375846 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.375827    2555 scope.go:117] "RemoveContainer" containerID="553ed7e91aab25fefac48da010731b0a6ce3397706423d74afdce32f68d417b8"
Jul 28 20:53:38.383990 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.383963    2555 scope.go:117] "RemoveContainer" containerID="3ad6664545f84b7b7a334b18cc78a64c1fdc1502c4657c9debc21d1c0739e9de"
Jul 28 20:53:38.384303 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:53:38.384282    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ad6664545f84b7b7a334b18cc78a64c1fdc1502c4657c9debc21d1c0739e9de\": container with ID starting with 3ad6664545f84b7b7a334b18cc78a64c1fdc1502c4657c9debc21d1c0739e9de not found: ID does not exist" containerID="3ad6664545f84b7b7a334b18cc78a64c1fdc1502c4657c9debc21d1c0739e9de"
Jul 28 20:53:38.384376 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.384314    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ad6664545f84b7b7a334b18cc78a64c1fdc1502c4657c9debc21d1c0739e9de"} err="failed to get container status \"3ad6664545f84b7b7a334b18cc78a64c1fdc1502c4657c9debc21d1c0739e9de\": rpc error: code = NotFound desc = could not find container \"3ad6664545f84b7b7a334b18cc78a64c1fdc1502c4657c9debc21d1c0739e9de\": container with ID starting with 3ad6664545f84b7b7a334b18cc78a64c1fdc1502c4657c9debc21d1c0739e9de not found: ID does not exist"
Jul 28 20:53:38.384376 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.384334    2555 scope.go:117] "RemoveContainer" containerID="553ed7e91aab25fefac48da010731b0a6ce3397706423d74afdce32f68d417b8"
Jul 28 20:53:38.384583 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:53:38.384558    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"553ed7e91aab25fefac48da010731b0a6ce3397706423d74afdce32f68d417b8\": container with ID starting with 553ed7e91aab25fefac48da010731b0a6ce3397706423d74afdce32f68d417b8 not found: ID does not exist" containerID="553ed7e91aab25fefac48da010731b0a6ce3397706423d74afdce32f68d417b8"
Jul 28 20:53:38.384638 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.384593    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"553ed7e91aab25fefac48da010731b0a6ce3397706423d74afdce32f68d417b8"} err="failed to get container status \"553ed7e91aab25fefac48da010731b0a6ce3397706423d74afdce32f68d417b8\": rpc error: code = NotFound desc = could not find container \"553ed7e91aab25fefac48da010731b0a6ce3397706423d74afdce32f68d417b8\": container with ID starting with 553ed7e91aab25fefac48da010731b0a6ce3397706423d74afdce32f68d417b8 not found: ID does not exist"
Jul 28 20:53:38.388849 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.388820    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"]
Jul 28 20:53:38.397641 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:38.397615    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2545433a-openshift-default-dbc85c66-nvhj9"]
Jul 28 20:53:39.985901 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:39.985859    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"]
Jul 28 20:53:39.986338 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:39.986241    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa9fa631-6724-4ad2-931f-0ac58a5942e7" containerName="istio-proxy"
Jul 28 20:53:39.986338 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:39.986253    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa9fa631-6724-4ad2-931f-0ac58a5942e7" containerName="istio-proxy"
Jul 28 20:53:39.986338 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:39.986267    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7" containerName="payload-processing"
Jul 28 20:53:39.986338 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:39.986273    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7" containerName="payload-processing"
Jul 28 20:53:39.986338 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:39.986331    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa9fa631-6724-4ad2-931f-0ac58a5942e7" containerName="istio-proxy"
Jul 28 20:53:39.986338 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:39.986342    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa9fa631-6724-4ad2-931f-0ac58a5942e7" containerName="istio-proxy"
Jul 28 20:53:39.986550 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:39.986350    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3d1b9fb-6cf7-4602-b8b2-bc10cdf7b5c7" containerName="payload-processing"
Jul 28 20:53:39.990652 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:39.990632    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"
Jul 28 20:53:39.993683 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:39.993661    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-e4b24854-dockercfg-p7jps\""
Jul 28 20:53:39.993803 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:39.993694    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-e4b24854\""
Jul 28 20:53:40.001579 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.001548    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"]
Jul 28 20:53:40.012147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.012118    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"]
Jul 28 20:53:40.012497 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.012484    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa9fa631-6724-4ad2-931f-0ac58a5942e7" containerName="istio-proxy"
Jul 28 20:53:40.012549 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.012499    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa9fa631-6724-4ad2-931f-0ac58a5942e7" containerName="istio-proxy"
Jul 28 20:53:40.015565 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.015544    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"
Jul 28 20:53:40.029745 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.029719    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"]
Jul 28 20:53:40.153282 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.153241    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n2nj\" (UniqueName: \"kubernetes.io/projected/33445993-836e-49e1-a5f9-9f5d302e8059-kube-api-access-7n2nj\") pod \"payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc\" (UID: \"33445993-836e-49e1-a5f9-9f5d302e8059\") " pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"
Jul 28 20:53:40.153463 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.153289    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7178e1d-c1cc-4c07-9f0d-3851e99223c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt\" (UID: \"d7178e1d-c1cc-4c07-9f0d-3851e99223c1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"
Jul 28 20:53:40.153463 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.153370    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxrrf\" (UniqueName: \"kubernetes.io/projected/d7178e1d-c1cc-4c07-9f0d-3851e99223c1-kube-api-access-lxrrf\") pod \"payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt\" (UID: \"d7178e1d-c1cc-4c07-9f0d-3851e99223c1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"
Jul 28 20:53:40.153463 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.153415    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33445993-836e-49e1-a5f9-9f5d302e8059-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc\" (UID: \"33445993-836e-49e1-a5f9-9f5d302e8059\") " pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"
Jul 28 20:53:40.254091 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.254004    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxrrf\" (UniqueName: \"kubernetes.io/projected/d7178e1d-c1cc-4c07-9f0d-3851e99223c1-kube-api-access-lxrrf\") pod \"payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt\" (UID: \"d7178e1d-c1cc-4c07-9f0d-3851e99223c1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"
Jul 28 20:53:40.254091 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.254051    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33445993-836e-49e1-a5f9-9f5d302e8059-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc\" (UID: \"33445993-836e-49e1-a5f9-9f5d302e8059\") " pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"
Jul 28 20:53:40.254280 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.254105    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n2nj\" (UniqueName: \"kubernetes.io/projected/33445993-836e-49e1-a5f9-9f5d302e8059-kube-api-access-7n2nj\") pod \"payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc\" (UID: \"33445993-836e-49e1-a5f9-9f5d302e8059\") " pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"
Jul 28 20:53:40.254280 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.254126    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7178e1d-c1cc-4c07-9f0d-3851e99223c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt\" (UID: \"d7178e1d-c1cc-4c07-9f0d-3851e99223c1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"
Jul 28 20:53:40.254849 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.254829    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7178e1d-c1cc-4c07-9f0d-3851e99223c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt\" (UID: \"d7178e1d-c1cc-4c07-9f0d-3851e99223c1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"
Jul 28 20:53:40.254885 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.254832    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33445993-836e-49e1-a5f9-9f5d302e8059-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc\" (UID: \"33445993-836e-49e1-a5f9-9f5d302e8059\") " pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"
Jul 28 20:53:40.263167 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.263138    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n2nj\" (UniqueName: \"kubernetes.io/projected/33445993-836e-49e1-a5f9-9f5d302e8059-kube-api-access-7n2nj\") pod \"payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc\" (UID: \"33445993-836e-49e1-a5f9-9f5d302e8059\") " pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"
Jul 28 20:53:40.263292 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.263220    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxrrf\" (UniqueName: \"kubernetes.io/projected/d7178e1d-c1cc-4c07-9f0d-3851e99223c1-kube-api-access-lxrrf\") pod \"payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt\" (UID: \"d7178e1d-c1cc-4c07-9f0d-3851e99223c1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"
Jul 28 20:53:40.294939 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.294907    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa9fa631-6724-4ad2-931f-0ac58a5942e7" path="/var/lib/kubelet/pods/aa9fa631-6724-4ad2-931f-0ac58a5942e7/volumes"
Jul 28 20:53:40.301154 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.301128    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"
Jul 28 20:53:40.325581 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.325546    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"
Jul 28 20:53:40.454026 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.453985    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"]
Jul 28 20:53:40.455702 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:53:40.455672    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7178e1d_c1cc_4c07_9f0d_3851e99223c1.slice/crio-ca391539441a11e4967f6a0fd5425035643c3e1d967a5627457eae4435f73a1b WatchSource:0}: Error finding container ca391539441a11e4967f6a0fd5425035643c3e1d967a5627457eae4435f73a1b: Status 404 returned error can't find the container with id ca391539441a11e4967f6a0fd5425035643c3e1d967a5627457eae4435f73a1b
Jul 28 20:53:40.482007 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:40.481985    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"]
Jul 28 20:53:40.497148 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:53:40.497119    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33445993_836e_49e1_a5f9_9f5d302e8059.slice/crio-42c752b91164b8a472d0170fa347996acb0c589968e2cf02b3955b9ba9544a9d WatchSource:0}: Error finding container 42c752b91164b8a472d0170fa347996acb0c589968e2cf02b3955b9ba9544a9d: Status 404 returned error can't find the container with id 42c752b91164b8a472d0170fa347996acb0c589968e2cf02b3955b9ba9544a9d
Jul 28 20:53:41.385363 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:41.385328    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt" event={"ID":"d7178e1d-c1cc-4c07-9f0d-3851e99223c1","Type":"ContainerStarted","Data":"f34249d632878c0c1dea128f92d0ee1e4ae5c12f997eeb37577d73db55a5e97b"}
Jul 28 20:53:41.385825 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:41.385384    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt" event={"ID":"d7178e1d-c1cc-4c07-9f0d-3851e99223c1","Type":"ContainerStarted","Data":"ca391539441a11e4967f6a0fd5425035643c3e1d967a5627457eae4435f73a1b"}
Jul 28 20:53:41.385825 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:41.385416    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"
Jul 28 20:53:41.386951 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:41.386910    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc" event={"ID":"33445993-836e-49e1-a5f9-9f5d302e8059","Type":"ContainerStarted","Data":"2fdb02e7b355d9c65173ae69f626c409703a2d78341e0a38e754a0f9c40d9489"}
Jul 28 20:53:41.387062 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:41.386966    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc" event={"ID":"33445993-836e-49e1-a5f9-9f5d302e8059","Type":"ContainerStarted","Data":"42c752b91164b8a472d0170fa347996acb0c589968e2cf02b3955b9ba9544a9d"}
Jul 28 20:53:41.387062 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:41.386986    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"
Jul 28 20:53:41.403165 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:41.403121    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt" podStartSLOduration=2.403104776 podStartE2EDuration="2.403104776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:53:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:53:41.400807336 +0000 UTC m=+1735.646184039" watchObservedRunningTime="2026-07-28 20:53:41.403104776 +0000 UTC m=+1735.648481481"
Jul 28 20:53:41.424255 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:41.424204    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc" podStartSLOduration=2.424190728 podStartE2EDuration="2.424190728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:53:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:53:41.422015722 +0000 UTC m=+1735.667392424" watchObservedRunningTime="2026-07-28 20:53:41.424190728 +0000 UTC m=+1735.669567429"
Jul 28 20:53:48.607027 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:48.606987    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:53:52.394489 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:52.394456    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"
Jul 28 20:53:52.395007 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:53:52.394580    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"
Jul 28 20:54:10.690741 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:10.690702    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"]
Jul 28 20:54:10.691251 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:10.690948    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc" podUID="33445993-836e-49e1-a5f9-9f5d302e8059" containerName="payload-processing" containerID="cri-o://2fdb02e7b355d9c65173ae69f626c409703a2d78341e0a38e754a0f9c40d9489" gracePeriod=30
Jul 28 20:54:10.699265 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:10.699234    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"]
Jul 28 20:54:10.699804 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:10.699776    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt" podUID="d7178e1d-c1cc-4c07-9f0d-3851e99223c1" containerName="payload-pre-processing" containerID="cri-o://f34249d632878c0c1dea128f92d0ee1e4ae5c12f997eeb37577d73db55a5e97b" gracePeriod=30
Jul 28 20:54:10.972005 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:10.971978    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"
Jul 28 20:54:10.999731 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:10.999702    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"
Jul 28 20:54:11.022339 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.022306    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33445993-836e-49e1-a5f9-9f5d302e8059-plugins-config-volume\") pod \"33445993-836e-49e1-a5f9-9f5d302e8059\" (UID: \"33445993-836e-49e1-a5f9-9f5d302e8059\") "
Jul 28 20:54:11.022503 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.022428    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n2nj\" (UniqueName: \"kubernetes.io/projected/33445993-836e-49e1-a5f9-9f5d302e8059-kube-api-access-7n2nj\") pod \"33445993-836e-49e1-a5f9-9f5d302e8059\" (UID: \"33445993-836e-49e1-a5f9-9f5d302e8059\") "
Jul 28 20:54:11.022711 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.022685    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33445993-836e-49e1-a5f9-9f5d302e8059-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "33445993-836e-49e1-a5f9-9f5d302e8059" (UID: "33445993-836e-49e1-a5f9-9f5d302e8059"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:54:11.024456 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.024431    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33445993-836e-49e1-a5f9-9f5d302e8059-kube-api-access-7n2nj" (OuterVolumeSpecName: "kube-api-access-7n2nj") pod "33445993-836e-49e1-a5f9-9f5d302e8059" (UID: "33445993-836e-49e1-a5f9-9f5d302e8059"). InnerVolumeSpecName "kube-api-access-7n2nj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:54:11.123201 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.123158    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7178e1d-c1cc-4c07-9f0d-3851e99223c1-plugins-config-volume\") pod \"d7178e1d-c1cc-4c07-9f0d-3851e99223c1\" (UID: \"d7178e1d-c1cc-4c07-9f0d-3851e99223c1\") "
Jul 28 20:54:11.123418 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.123245    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxrrf\" (UniqueName: \"kubernetes.io/projected/d7178e1d-c1cc-4c07-9f0d-3851e99223c1-kube-api-access-lxrrf\") pod \"d7178e1d-c1cc-4c07-9f0d-3851e99223c1\" (UID: \"d7178e1d-c1cc-4c07-9f0d-3851e99223c1\") "
Jul 28 20:54:11.123584 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.123559    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7178e1d-c1cc-4c07-9f0d-3851e99223c1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d7178e1d-c1cc-4c07-9f0d-3851e99223c1" (UID: "d7178e1d-c1cc-4c07-9f0d-3851e99223c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:54:11.123645 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.123570    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33445993-836e-49e1-a5f9-9f5d302e8059-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:54:11.123645 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.123613    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n2nj\" (UniqueName: \"kubernetes.io/projected/33445993-836e-49e1-a5f9-9f5d302e8059-kube-api-access-7n2nj\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:54:11.125290 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.125264    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7178e1d-c1cc-4c07-9f0d-3851e99223c1-kube-api-access-lxrrf" (OuterVolumeSpecName: "kube-api-access-lxrrf") pod "d7178e1d-c1cc-4c07-9f0d-3851e99223c1" (UID: "d7178e1d-c1cc-4c07-9f0d-3851e99223c1"). InnerVolumeSpecName "kube-api-access-lxrrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:54:11.224461 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.224375    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxrrf\" (UniqueName: \"kubernetes.io/projected/d7178e1d-c1cc-4c07-9f0d-3851e99223c1-kube-api-access-lxrrf\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:54:11.224461 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.224402    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7178e1d-c1cc-4c07-9f0d-3851e99223c1-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:54:11.532362 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.532272    2555 generic.go:356] "Generic (PLEG): container finished" podID="d7178e1d-c1cc-4c07-9f0d-3851e99223c1" containerID="f34249d632878c0c1dea128f92d0ee1e4ae5c12f997eeb37577d73db55a5e97b" exitCode=0
Jul 28 20:54:11.532362 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.532325    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"
Jul 28 20:54:11.532578 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.532362    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt" event={"ID":"d7178e1d-c1cc-4c07-9f0d-3851e99223c1","Type":"ContainerDied","Data":"f34249d632878c0c1dea128f92d0ee1e4ae5c12f997eeb37577d73db55a5e97b"}
Jul 28 20:54:11.532578 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.532420    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt" event={"ID":"d7178e1d-c1cc-4c07-9f0d-3851e99223c1","Type":"ContainerDied","Data":"ca391539441a11e4967f6a0fd5425035643c3e1d967a5627457eae4435f73a1b"}
Jul 28 20:54:11.532578 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.532448    2555 scope.go:117] "RemoveContainer" containerID="f34249d632878c0c1dea128f92d0ee1e4ae5c12f997eeb37577d73db55a5e97b"
Jul 28 20:54:11.533687 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.533667    2555 generic.go:356] "Generic (PLEG): container finished" podID="33445993-836e-49e1-a5f9-9f5d302e8059" containerID="2fdb02e7b355d9c65173ae69f626c409703a2d78341e0a38e754a0f9c40d9489" exitCode=0
Jul 28 20:54:11.533777 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.533698    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc" event={"ID":"33445993-836e-49e1-a5f9-9f5d302e8059","Type":"ContainerDied","Data":"2fdb02e7b355d9c65173ae69f626c409703a2d78341e0a38e754a0f9c40d9489"}
Jul 28 20:54:11.533777 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.533717    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"
Jul 28 20:54:11.533777 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.533749    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc" event={"ID":"33445993-836e-49e1-a5f9-9f5d302e8059","Type":"ContainerDied","Data":"42c752b91164b8a472d0170fa347996acb0c589968e2cf02b3955b9ba9544a9d"}
Jul 28 20:54:11.542387 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.542369    2555 scope.go:117] "RemoveContainer" containerID="f34249d632878c0c1dea128f92d0ee1e4ae5c12f997eeb37577d73db55a5e97b"
Jul 28 20:54:11.542654 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:54:11.542637    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f34249d632878c0c1dea128f92d0ee1e4ae5c12f997eeb37577d73db55a5e97b\": container with ID starting with f34249d632878c0c1dea128f92d0ee1e4ae5c12f997eeb37577d73db55a5e97b not found: ID does not exist" containerID="f34249d632878c0c1dea128f92d0ee1e4ae5c12f997eeb37577d73db55a5e97b"
Jul 28 20:54:11.542719 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.542666    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f34249d632878c0c1dea128f92d0ee1e4ae5c12f997eeb37577d73db55a5e97b"} err="failed to get container status \"f34249d632878c0c1dea128f92d0ee1e4ae5c12f997eeb37577d73db55a5e97b\": rpc error: code = NotFound desc = could not find container \"f34249d632878c0c1dea128f92d0ee1e4ae5c12f997eeb37577d73db55a5e97b\": container with ID starting with f34249d632878c0c1dea128f92d0ee1e4ae5c12f997eeb37577d73db55a5e97b not found: ID does not exist"
Jul 28 20:54:11.542719 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.542689    2555 scope.go:117] "RemoveContainer" containerID="2fdb02e7b355d9c65173ae69f626c409703a2d78341e0a38e754a0f9c40d9489"
Jul 28 20:54:11.551099 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.551079    2555 scope.go:117] "RemoveContainer" containerID="2fdb02e7b355d9c65173ae69f626c409703a2d78341e0a38e754a0f9c40d9489"
Jul 28 20:54:11.551377 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:54:11.551355    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fdb02e7b355d9c65173ae69f626c409703a2d78341e0a38e754a0f9c40d9489\": container with ID starting with 2fdb02e7b355d9c65173ae69f626c409703a2d78341e0a38e754a0f9c40d9489 not found: ID does not exist" containerID="2fdb02e7b355d9c65173ae69f626c409703a2d78341e0a38e754a0f9c40d9489"
Jul 28 20:54:11.551448 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.551384    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fdb02e7b355d9c65173ae69f626c409703a2d78341e0a38e754a0f9c40d9489"} err="failed to get container status \"2fdb02e7b355d9c65173ae69f626c409703a2d78341e0a38e754a0f9c40d9489\": rpc error: code = NotFound desc = could not find container \"2fdb02e7b355d9c65173ae69f626c409703a2d78341e0a38e754a0f9c40d9489\": container with ID starting with 2fdb02e7b355d9c65173ae69f626c409703a2d78341e0a38e754a0f9c40d9489 not found: ID does not exist"
Jul 28 20:54:11.564111 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.564086    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"]
Jul 28 20:54:11.570648 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.570616    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e4b24854-5bf4fd5bbd-s6tzt"]
Jul 28 20:54:11.584801 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.584771    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"]
Jul 28 20:54:11.592524 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.592500    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e4b24854-68dbd848c7-5d8qc"]
Jul 28 20:54:11.927469 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.927436    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"]
Jul 28 20:54:11.927845 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.927810    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7178e1d-c1cc-4c07-9f0d-3851e99223c1" containerName="payload-pre-processing"
Jul 28 20:54:11.927845 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.927822    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7178e1d-c1cc-4c07-9f0d-3851e99223c1" containerName="payload-pre-processing"
Jul 28 20:54:11.927845 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.927841    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33445993-836e-49e1-a5f9-9f5d302e8059" containerName="payload-processing"
Jul 28 20:54:11.927964 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.927847    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="33445993-836e-49e1-a5f9-9f5d302e8059" containerName="payload-processing"
Jul 28 20:54:11.927964 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.927907    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="33445993-836e-49e1-a5f9-9f5d302e8059" containerName="payload-processing"
Jul 28 20:54:11.927964 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.927918    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7178e1d-c1cc-4c07-9f0d-3851e99223c1" containerName="payload-pre-processing"
Jul 28 20:54:11.932299 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.932279    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:11.935713 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.935691    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ee318a23-openshift-default-dockercfg-w7hc8\""
Jul 28 20:54:11.956547 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:11.956517    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"]
Jul 28 20:54:12.031807 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.031768    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj52t\" (UniqueName: \"kubernetes.io/projected/24017442-58ba-44a6-b563-acc9c73ad935-kube-api-access-sj52t\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.032020 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.031838    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-istio-data\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.032020 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.031900    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-credential-socket\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.032020 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.031925    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24017442-58ba-44a6-b563-acc9c73ad935-istio-token\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.032020 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.031965    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24017442-58ba-44a6-b563-acc9c73ad935-istiod-ca-cert\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.032020 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.031986    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-workload-certs\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.032329 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.032125    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24017442-58ba-44a6-b563-acc9c73ad935-istio-podinfo\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.032329 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.032159    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-workload-socket\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.032329 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.032184    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-istio-envoy\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.132999 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.132957    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-istio-data\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.133207 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.133032    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-credential-socket\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.133207 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.133058    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24017442-58ba-44a6-b563-acc9c73ad935-istio-token\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.133207 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.133081    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24017442-58ba-44a6-b563-acc9c73ad935-istiod-ca-cert\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.133207 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.133161    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-workload-certs\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.133431 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.133237    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24017442-58ba-44a6-b563-acc9c73ad935-istio-podinfo\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.133431 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.133282    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-workload-socket\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.133431 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.133318    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-istio-envoy\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.133431 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.133377    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj52t\" (UniqueName: \"kubernetes.io/projected/24017442-58ba-44a6-b563-acc9c73ad935-kube-api-access-sj52t\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.133630 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.133451    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-istio-data\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.133630 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.133466    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-credential-socket\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.133751 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.133665    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-workload-certs\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.133751 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.133704    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-workload-socket\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.134296 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.134274    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24017442-58ba-44a6-b563-acc9c73ad935-istiod-ca-cert\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.135673 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.135644    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-istio-envoy\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.135817 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.135798    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24017442-58ba-44a6-b563-acc9c73ad935-istio-podinfo\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.143875 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.143854    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24017442-58ba-44a6-b563-acc9c73ad935-istio-token\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.144021 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.143972    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj52t\" (UniqueName: \"kubernetes.io/projected/24017442-58ba-44a6-b563-acc9c73ad935-kube-api-access-sj52t\") pod \"e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") " pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.242920 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.242830    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:12.297078 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.296715    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33445993-836e-49e1-a5f9-9f5d302e8059" path="/var/lib/kubelet/pods/33445993-836e-49e1-a5f9-9f5d302e8059/volumes"
Jul 28 20:54:12.297733 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.297322    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7178e1d-c1cc-4c07-9f0d-3851e99223c1" path="/var/lib/kubelet/pods/d7178e1d-c1cc-4c07-9f0d-3851e99223c1/volumes"
Jul 28 20:54:12.390783 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.390756    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"]
Jul 28 20:54:12.393541 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:54:12.393502    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24017442_58ba_44a6_b563_acc9c73ad935.slice/crio-8adefe20400081daff5c761cf7c915619b422114c9460dc35943e843496e05d1 WatchSource:0}: Error finding container 8adefe20400081daff5c761cf7c915619b422114c9460dc35943e843496e05d1: Status 404 returned error can't find the container with id 8adefe20400081daff5c761cf7c915619b422114c9460dc35943e843496e05d1
Jul 28 20:54:12.395555 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.395521    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:54:12.395628 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.395590    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:54:12.395665 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.395622    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:54:12.540911 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.540814    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79" event={"ID":"24017442-58ba-44a6-b563-acc9c73ad935","Type":"ContainerStarted","Data":"c44cc71cb7c2b94d56b6c981d90558fca010c1584a1e08f8314cca8868b910ab"}
Jul 28 20:54:12.540911 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.540880    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79" event={"ID":"24017442-58ba-44a6-b563-acc9c73ad935","Type":"ContainerStarted","Data":"8adefe20400081daff5c761cf7c915619b422114c9460dc35943e843496e05d1"}
Jul 28 20:54:12.568159 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:12.568096    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79" podStartSLOduration=1.568073582 podStartE2EDuration="1.568073582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:54:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:54:12.567321356 +0000 UTC m=+1766.812698059" watchObservedRunningTime="2026-07-28 20:54:12.568073582 +0000 UTC m=+1766.813450285"
Jul 28 20:54:13.243584 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:13.243547    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:13.248434 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:13.248409    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:13.548094 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:13.548014    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:13.549061 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:13.549041    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:14.915350 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:14.915314    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:54:25.198961 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:25.198891    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:54:28.815458 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:28.814577    2555 patch_prober.go:28] interesting pod/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": read tcp 10.132.0.2:40720->10.132.0.43:15021: read: connection reset by peer" start-of-body=
Jul 28 20:54:28.815458 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:28.814644    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79" podUID="24017442-58ba-44a6-b563-acc9c73ad935" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": read tcp 10.132.0.2:40720->10.132.0.43:15021: read: connection reset by peer"
Jul 28 20:54:29.627540 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:29.627501    2555 generic.go:356] "Generic (PLEG): container finished" podID="24017442-58ba-44a6-b563-acc9c73ad935" containerID="c44cc71cb7c2b94d56b6c981d90558fca010c1584a1e08f8314cca8868b910ab" exitCode=0
Jul 28 20:54:29.627722 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:29.627575    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79" event={"ID":"24017442-58ba-44a6-b563-acc9c73ad935","Type":"ContainerDied","Data":"c44cc71cb7c2b94d56b6c981d90558fca010c1584a1e08f8314cca8868b910ab"}
Jul 28 20:54:29.628041 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:29.628025    2555 scope.go:117] "RemoveContainer" containerID="c44cc71cb7c2b94d56b6c981d90558fca010c1584a1e08f8314cca8868b910ab"
Jul 28 20:54:29.629083 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:29.629053    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:54:29.629164 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:29.629130    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:54:29.629202 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:29.629163    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:54:30.634697 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:30.634658    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79" event={"ID":"24017442-58ba-44a6-b563-acc9c73ad935","Type":"ContainerStarted","Data":"d6d15b9cca701e65fb279a28822d09208018faf08d38bb155cef2ccc4d1533a2"}
Jul 28 20:54:31.243121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:31.243081    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:31.243421 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:31.243400    2555 patch_prober.go:28] interesting pod/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 28 20:54:31.243481 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:31.243451    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79" podUID="24017442-58ba-44a6-b563-acc9c73ad935" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 28 20:54:32.244238 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:32.244195    2555 patch_prober.go:28] interesting pod/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 28 20:54:32.244674 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:32.244267    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79" podUID="24017442-58ba-44a6-b563-acc9c73ad935" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 28 20:54:33.243374 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:33.243331    2555 patch_prober.go:28] interesting pod/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 28 20:54:33.243563 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:33.243394    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79" podUID="24017442-58ba-44a6-b563-acc9c73ad935" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 28 20:54:34.243427 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:34.243388    2555 patch_prober.go:28] interesting pod/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 28 20:54:34.243827 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:34.243447    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79" podUID="24017442-58ba-44a6-b563-acc9c73ad935" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 28 20:54:35.247102 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:35.247070    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:35.247544 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:35.247451    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:35.248093 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:35.248074    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:46.355153 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:46.355113    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:54:46.357871 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:46.357850    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:54:46.420863 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:46.420836    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"]
Jul 28 20:54:46.421083 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:46.421054    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79" podUID="24017442-58ba-44a6-b563-acc9c73ad935" containerName="istio-proxy" containerID="cri-o://d6d15b9cca701e65fb279a28822d09208018faf08d38bb155cef2ccc4d1533a2" gracePeriod=30
Jul 28 20:54:48.356006 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:48.355964    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:54:50.250030 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:50.249981    2555 patch_prober.go:28] interesting pod/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 20:54:50.250443 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:50.250051    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79" podUID="24017442-58ba-44a6-b563-acc9c73ad935" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:54:51.682361 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.682333    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:51.738454 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.738354    2555 generic.go:356] "Generic (PLEG): container finished" podID="24017442-58ba-44a6-b563-acc9c73ad935" containerID="d6d15b9cca701e65fb279a28822d09208018faf08d38bb155cef2ccc4d1533a2" exitCode=0
Jul 28 20:54:51.738454 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.738401    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"
Jul 28 20:54:51.738454 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.738444    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79" event={"ID":"24017442-58ba-44a6-b563-acc9c73ad935","Type":"ContainerDied","Data":"d6d15b9cca701e65fb279a28822d09208018faf08d38bb155cef2ccc4d1533a2"}
Jul 28 20:54:51.738766 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.738511    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79" event={"ID":"24017442-58ba-44a6-b563-acc9c73ad935","Type":"ContainerDied","Data":"8adefe20400081daff5c761cf7c915619b422114c9460dc35943e843496e05d1"}
Jul 28 20:54:51.738766 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.738544    2555 scope.go:117] "RemoveContainer" containerID="d6d15b9cca701e65fb279a28822d09208018faf08d38bb155cef2ccc4d1533a2"
Jul 28 20:54:51.747466 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.747444    2555 scope.go:117] "RemoveContainer" containerID="c44cc71cb7c2b94d56b6c981d90558fca010c1584a1e08f8314cca8868b910ab"
Jul 28 20:54:51.755833 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.755813    2555 scope.go:117] "RemoveContainer" containerID="d6d15b9cca701e65fb279a28822d09208018faf08d38bb155cef2ccc4d1533a2"
Jul 28 20:54:51.756149 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:54:51.756125    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6d15b9cca701e65fb279a28822d09208018faf08d38bb155cef2ccc4d1533a2\": container with ID starting with d6d15b9cca701e65fb279a28822d09208018faf08d38bb155cef2ccc4d1533a2 not found: ID does not exist" containerID="d6d15b9cca701e65fb279a28822d09208018faf08d38bb155cef2ccc4d1533a2"
Jul 28 20:54:51.756216 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.756160    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6d15b9cca701e65fb279a28822d09208018faf08d38bb155cef2ccc4d1533a2"} err="failed to get container status \"d6d15b9cca701e65fb279a28822d09208018faf08d38bb155cef2ccc4d1533a2\": rpc error: code = NotFound desc = could not find container \"d6d15b9cca701e65fb279a28822d09208018faf08d38bb155cef2ccc4d1533a2\": container with ID starting with d6d15b9cca701e65fb279a28822d09208018faf08d38bb155cef2ccc4d1533a2 not found: ID does not exist"
Jul 28 20:54:51.756216 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.756180    2555 scope.go:117] "RemoveContainer" containerID="c44cc71cb7c2b94d56b6c981d90558fca010c1584a1e08f8314cca8868b910ab"
Jul 28 20:54:51.756458 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:54:51.756439    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c44cc71cb7c2b94d56b6c981d90558fca010c1584a1e08f8314cca8868b910ab\": container with ID starting with c44cc71cb7c2b94d56b6c981d90558fca010c1584a1e08f8314cca8868b910ab not found: ID does not exist" containerID="c44cc71cb7c2b94d56b6c981d90558fca010c1584a1e08f8314cca8868b910ab"
Jul 28 20:54:51.756522 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.756474    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c44cc71cb7c2b94d56b6c981d90558fca010c1584a1e08f8314cca8868b910ab"} err="failed to get container status \"c44cc71cb7c2b94d56b6c981d90558fca010c1584a1e08f8314cca8868b910ab\": rpc error: code = NotFound desc = could not find container \"c44cc71cb7c2b94d56b6c981d90558fca010c1584a1e08f8314cca8868b910ab\": container with ID starting with c44cc71cb7c2b94d56b6c981d90558fca010c1584a1e08f8314cca8868b910ab not found: ID does not exist"
Jul 28 20:54:51.818025 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.817979    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj52t\" (UniqueName: \"kubernetes.io/projected/24017442-58ba-44a6-b563-acc9c73ad935-kube-api-access-sj52t\") pod \"24017442-58ba-44a6-b563-acc9c73ad935\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") "
Jul 28 20:54:51.818025 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.818033    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-istio-envoy\") pod \"24017442-58ba-44a6-b563-acc9c73ad935\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") "
Jul 28 20:54:51.818286 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.818089    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24017442-58ba-44a6-b563-acc9c73ad935-istio-token\") pod \"24017442-58ba-44a6-b563-acc9c73ad935\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") "
Jul 28 20:54:51.818286 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.818116    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24017442-58ba-44a6-b563-acc9c73ad935-istiod-ca-cert\") pod \"24017442-58ba-44a6-b563-acc9c73ad935\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") "
Jul 28 20:54:51.818286 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.818138    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24017442-58ba-44a6-b563-acc9c73ad935-istio-podinfo\") pod \"24017442-58ba-44a6-b563-acc9c73ad935\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") "
Jul 28 20:54:51.818286 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.818172    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-workload-socket\") pod \"24017442-58ba-44a6-b563-acc9c73ad935\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") "
Jul 28 20:54:51.818286 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.818215    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-credential-socket\") pod \"24017442-58ba-44a6-b563-acc9c73ad935\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") "
Jul 28 20:54:51.818551 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.818510    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "24017442-58ba-44a6-b563-acc9c73ad935" (UID: "24017442-58ba-44a6-b563-acc9c73ad935"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:54:51.818551 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.818536    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24017442-58ba-44a6-b563-acc9c73ad935-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "24017442-58ba-44a6-b563-acc9c73ad935" (UID: "24017442-58ba-44a6-b563-acc9c73ad935"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:54:51.818662 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.818532    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "24017442-58ba-44a6-b563-acc9c73ad935" (UID: "24017442-58ba-44a6-b563-acc9c73ad935"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:54:51.818662 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.818569    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-istio-data\") pod \"24017442-58ba-44a6-b563-acc9c73ad935\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") "
Jul 28 20:54:51.818662 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.818603    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-workload-certs\") pod \"24017442-58ba-44a6-b563-acc9c73ad935\" (UID: \"24017442-58ba-44a6-b563-acc9c73ad935\") "
Jul 28 20:54:51.819030 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.819010    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-workload-socket\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:54:51.819135 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.819010    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "24017442-58ba-44a6-b563-acc9c73ad935" (UID: "24017442-58ba-44a6-b563-acc9c73ad935"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:54:51.819135 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.819032    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-credential-socket\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:54:51.819135 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.819067    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24017442-58ba-44a6-b563-acc9c73ad935-istiod-ca-cert\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:54:51.819616 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.819593    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-istio-data" (OuterVolumeSpecName: "istio-data") pod "24017442-58ba-44a6-b563-acc9c73ad935" (UID: "24017442-58ba-44a6-b563-acc9c73ad935"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:54:51.820504 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.820482    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24017442-58ba-44a6-b563-acc9c73ad935-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "24017442-58ba-44a6-b563-acc9c73ad935" (UID: "24017442-58ba-44a6-b563-acc9c73ad935"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:54:51.820583 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.820558    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "24017442-58ba-44a6-b563-acc9c73ad935" (UID: "24017442-58ba-44a6-b563-acc9c73ad935"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:54:51.820724 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.820707    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24017442-58ba-44a6-b563-acc9c73ad935-kube-api-access-sj52t" (OuterVolumeSpecName: "kube-api-access-sj52t") pod "24017442-58ba-44a6-b563-acc9c73ad935" (UID: "24017442-58ba-44a6-b563-acc9c73ad935"). InnerVolumeSpecName "kube-api-access-sj52t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:54:51.820781 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.820705    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24017442-58ba-44a6-b563-acc9c73ad935-istio-token" (OuterVolumeSpecName: "istio-token") pod "24017442-58ba-44a6-b563-acc9c73ad935" (UID: "24017442-58ba-44a6-b563-acc9c73ad935"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:54:51.920321 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.920285    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-istio-data\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:54:51.920321 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.920317    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-workload-certs\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:54:51.920535 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.920328    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj52t\" (UniqueName: \"kubernetes.io/projected/24017442-58ba-44a6-b563-acc9c73ad935-kube-api-access-sj52t\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:54:51.920535 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.920341    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24017442-58ba-44a6-b563-acc9c73ad935-istio-envoy\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:54:51.920535 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.920351    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24017442-58ba-44a6-b563-acc9c73ad935-istio-token\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:54:51.920535 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:51.920358    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24017442-58ba-44a6-b563-acc9c73ad935-istio-podinfo\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:54:52.061913 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:52.061876    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"]
Jul 28 20:54:52.068359 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:52.068328    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ee318a23-openshift-default-8469bf94d-vdt79"]
Jul 28 20:54:52.297058 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:52.296974    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24017442-58ba-44a6-b563-acc9c73ad935" path="/var/lib/kubelet/pods/24017442-58ba-44a6-b563-acc9c73ad935/volumes"
Jul 28 20:54:59.109788 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:54:59.109750    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:55:14.686698 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:14.686662    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4871db53-fq566"]
Jul 28 20:55:14.687097 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:14.687019    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24017442-58ba-44a6-b563-acc9c73ad935" containerName="istio-proxy"
Jul 28 20:55:14.687097 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:14.687031    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="24017442-58ba-44a6-b563-acc9c73ad935" containerName="istio-proxy"
Jul 28 20:55:14.687097 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:14.687039    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24017442-58ba-44a6-b563-acc9c73ad935" containerName="istio-proxy"
Jul 28 20:55:14.687097 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:14.687044    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="24017442-58ba-44a6-b563-acc9c73ad935" containerName="istio-proxy"
Jul 28 20:55:14.687235 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:14.687110    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="24017442-58ba-44a6-b563-acc9c73ad935" containerName="istio-proxy"
Jul 28 20:55:14.687235 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:14.687119    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="24017442-58ba-44a6-b563-acc9c73ad935" containerName="istio-proxy"
Jul 28 20:55:14.691499 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:14.691481    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4871db53-fq566"
Jul 28 20:55:14.693780 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:14.693746    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxpsn\""
Jul 28 20:55:14.693854 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:14.693819    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 20:55:14.698850 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:14.698591    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4871db53-fq566"]
Jul 28 20:55:14.827622 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:14.827577    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9572aa5-5742-47c9-a52f-a9f03a57df16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-4871db53-fq566\" (UID: \"a9572aa5-5742-47c9-a52f-a9f03a57df16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4871db53-fq566"
Jul 28 20:55:14.928437 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:14.928404    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9572aa5-5742-47c9-a52f-a9f03a57df16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-4871db53-fq566\" (UID: \"a9572aa5-5742-47c9-a52f-a9f03a57df16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4871db53-fq566"
Jul 28 20:55:14.929028 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:14.929010    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9572aa5-5742-47c9-a52f-a9f03a57df16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-4871db53-fq566\" (UID: \"a9572aa5-5742-47c9-a52f-a9f03a57df16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4871db53-fq566"
Jul 28 20:55:15.010908 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:15.010814    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4871db53-fq566"
Jul 28 20:55:15.149044 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:15.149012    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4871db53-fq566"]
Jul 28 20:55:15.152346 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:55:15.152317    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9572aa5_5742_47c9_a52f_a9f03a57df16.slice/crio-ad49a7425afa93d480d8ca818cf2a940677680bdc2a509ce3bf0af6adc315847 WatchSource:0}: Error finding container ad49a7425afa93d480d8ca818cf2a940677680bdc2a509ce3bf0af6adc315847: Status 404 returned error can't find the container with id ad49a7425afa93d480d8ca818cf2a940677680bdc2a509ce3bf0af6adc315847
Jul 28 20:55:15.154651 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:15.154632    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:55:15.851991 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:15.851955    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4871db53-fq566" event={"ID":"a9572aa5-5742-47c9-a52f-a9f03a57df16","Type":"ContainerStarted","Data":"ad49a7425afa93d480d8ca818cf2a940677680bdc2a509ce3bf0af6adc315847"}
Jul 28 20:55:18.867853 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:18.867822    2555 generic.go:356] "Generic (PLEG): container finished" podID="a9572aa5-5742-47c9-a52f-a9f03a57df16" containerID="e08dafc93ee72ef3500d63085f3b76fb36568e859e6231b33d3cd5b9a96f74cc" exitCode=0
Jul 28 20:55:18.868257 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:18.867889    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4871db53-fq566" event={"ID":"a9572aa5-5742-47c9-a52f-a9f03a57df16","Type":"ContainerDied","Data":"e08dafc93ee72ef3500d63085f3b76fb36568e859e6231b33d3cd5b9a96f74cc"}
Jul 28 20:55:20.008322 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:20.008296    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4871db53-fq566"
Jul 28 20:55:20.178158 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:20.178056    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9572aa5-5742-47c9-a52f-a9f03a57df16-maas-api-service-ca\") pod \"a9572aa5-5742-47c9-a52f-a9f03a57df16\" (UID: \"a9572aa5-5742-47c9-a52f-a9f03a57df16\") "
Jul 28 20:55:20.178419 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:20.178393    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9572aa5-5742-47c9-a52f-a9f03a57df16-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a9572aa5-5742-47c9-a52f-a9f03a57df16" (UID: "a9572aa5-5742-47c9-a52f-a9f03a57df16"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:55:20.279522 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:20.279475    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9572aa5-5742-47c9-a52f-a9f03a57df16-maas-api-service-ca\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:55:20.878033 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:20.877999    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4871db53-fq566"
Jul 28 20:55:20.878223 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:20.878056    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4871db53-fq566" event={"ID":"a9572aa5-5742-47c9-a52f-a9f03a57df16","Type":"ContainerDied","Data":"ad49a7425afa93d480d8ca818cf2a940677680bdc2a509ce3bf0af6adc315847"}
Jul 28 20:55:20.878223 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:20.878104    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad49a7425afa93d480d8ca818cf2a940677680bdc2a509ce3bf0af6adc315847"
Jul 28 20:55:30.342439 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:30.342400    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4871db53-fq566"]
Jul 28 20:55:30.345333 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:30.345304    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-4871db53-fq566"]
Jul 28 20:55:32.295244 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:32.295207    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9572aa5-5742-47c9-a52f-a9f03a57df16" path="/var/lib/kubelet/pods/a9572aa5-5742-47c9-a52f-a9f03a57df16/volumes"
Jul 28 20:55:34.097112 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:34.097073    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:55:45.215617 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:55:45.215579    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:56:58.402749 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:56:58.402709    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:57:06.502284 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:06.502248    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:57:19.523578 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.523538    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"]
Jul 28 20:57:19.524112 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.524097    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9572aa5-5742-47c9-a52f-a9f03a57df16" containerName="revoke-keys"
Jul 28 20:57:19.524166 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.524115    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9572aa5-5742-47c9-a52f-a9f03a57df16" containerName="revoke-keys"
Jul 28 20:57:19.524239 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.524228    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9572aa5-5742-47c9-a52f-a9f03a57df16" containerName="revoke-keys"
Jul 28 20:57:19.527492 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.527473    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"
Jul 28 20:57:19.530147 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.530126    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-2c06c6bc\""
Jul 28 20:57:19.530240 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.530175    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-2c06c6bc-dockercfg-966rq\""
Jul 28 20:57:19.538779 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.538754    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"]
Jul 28 20:57:19.560362 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.560327    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"]
Jul 28 20:57:19.563782 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.563764    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"
Jul 28 20:57:19.571373 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.571348    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"]
Jul 28 20:57:19.628422 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.628379    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/666ce654-e3f0-4a94-9006-57372f7c0e52-plugins-config-volume\") pod \"payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c\" (UID: \"666ce654-e3f0-4a94-9006-57372f7c0e52\") " pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"
Jul 28 20:57:19.628607 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.628488    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqgv7\" (UniqueName: \"kubernetes.io/projected/666ce654-e3f0-4a94-9006-57372f7c0e52-kube-api-access-cqgv7\") pod \"payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c\" (UID: \"666ce654-e3f0-4a94-9006-57372f7c0e52\") " pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"
Jul 28 20:57:19.628607 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.628542    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhbhp\" (UniqueName: \"kubernetes.io/projected/92fdaf2a-69f9-46e6-9099-0ec9b1497cda-kube-api-access-bhbhp\") pod \"payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7\" (UID: \"92fdaf2a-69f9-46e6-9099-0ec9b1497cda\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"
Jul 28 20:57:19.628709 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.628613    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92fdaf2a-69f9-46e6-9099-0ec9b1497cda-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7\" (UID: \"92fdaf2a-69f9-46e6-9099-0ec9b1497cda\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"
Jul 28 20:57:19.729313 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.729275    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqgv7\" (UniqueName: \"kubernetes.io/projected/666ce654-e3f0-4a94-9006-57372f7c0e52-kube-api-access-cqgv7\") pod \"payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c\" (UID: \"666ce654-e3f0-4a94-9006-57372f7c0e52\") " pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"
Jul 28 20:57:19.729313 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.729319    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhbhp\" (UniqueName: \"kubernetes.io/projected/92fdaf2a-69f9-46e6-9099-0ec9b1497cda-kube-api-access-bhbhp\") pod \"payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7\" (UID: \"92fdaf2a-69f9-46e6-9099-0ec9b1497cda\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"
Jul 28 20:57:19.729568 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.729403    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92fdaf2a-69f9-46e6-9099-0ec9b1497cda-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7\" (UID: \"92fdaf2a-69f9-46e6-9099-0ec9b1497cda\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"
Jul 28 20:57:19.729568 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.729434    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/666ce654-e3f0-4a94-9006-57372f7c0e52-plugins-config-volume\") pod \"payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c\" (UID: \"666ce654-e3f0-4a94-9006-57372f7c0e52\") " pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"
Jul 28 20:57:19.730210 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.730191    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/666ce654-e3f0-4a94-9006-57372f7c0e52-plugins-config-volume\") pod \"payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c\" (UID: \"666ce654-e3f0-4a94-9006-57372f7c0e52\") " pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"
Jul 28 20:57:19.730424 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.730398    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92fdaf2a-69f9-46e6-9099-0ec9b1497cda-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7\" (UID: \"92fdaf2a-69f9-46e6-9099-0ec9b1497cda\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"
Jul 28 20:57:19.738193 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.738164    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhbhp\" (UniqueName: \"kubernetes.io/projected/92fdaf2a-69f9-46e6-9099-0ec9b1497cda-kube-api-access-bhbhp\") pod \"payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7\" (UID: \"92fdaf2a-69f9-46e6-9099-0ec9b1497cda\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"
Jul 28 20:57:19.738418 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.738392    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqgv7\" (UniqueName: \"kubernetes.io/projected/666ce654-e3f0-4a94-9006-57372f7c0e52-kube-api-access-cqgv7\") pod \"payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c\" (UID: \"666ce654-e3f0-4a94-9006-57372f7c0e52\") " pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"
Jul 28 20:57:19.838864 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.838815    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"
Jul 28 20:57:19.876330 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:19.876286    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"
Jul 28 20:57:20.193758 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:20.193731    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"]
Jul 28 20:57:20.195752 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:57:20.195723    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92fdaf2a_69f9_46e6_9099_0ec9b1497cda.slice/crio-af8213338893606bec6d77a1eb0620c2f88fba850500bb55fdf16ae58b39bd5c WatchSource:0}: Error finding container af8213338893606bec6d77a1eb0620c2f88fba850500bb55fdf16ae58b39bd5c: Status 404 returned error can't find the container with id af8213338893606bec6d77a1eb0620c2f88fba850500bb55fdf16ae58b39bd5c
Jul 28 20:57:20.257533 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:20.257509    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"]
Jul 28 20:57:20.258273 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:57:20.258248    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666ce654_e3f0_4a94_9006_57372f7c0e52.slice/crio-e1454b340055629b0927ffe9c6a211e5804eff6b1d81f4ced279f0bd790736a0 WatchSource:0}: Error finding container e1454b340055629b0927ffe9c6a211e5804eff6b1d81f4ced279f0bd790736a0: Status 404 returned error can't find the container with id e1454b340055629b0927ffe9c6a211e5804eff6b1d81f4ced279f0bd790736a0
Jul 28 20:57:20.387303 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:20.387259    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:57:20.451640 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:20.451532    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7" event={"ID":"92fdaf2a-69f9-46e6-9099-0ec9b1497cda","Type":"ContainerStarted","Data":"d8ac7a8edb4fb2b3e05cc3d42fc7a6b113b92b2511e2acaafa27e7a001916b11"}
Jul 28 20:57:20.451640 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:20.451610    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"
Jul 28 20:57:20.451640 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:20.451635    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7" event={"ID":"92fdaf2a-69f9-46e6-9099-0ec9b1497cda","Type":"ContainerStarted","Data":"af8213338893606bec6d77a1eb0620c2f88fba850500bb55fdf16ae58b39bd5c"}
Jul 28 20:57:20.453071 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:20.453045    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c" event={"ID":"666ce654-e3f0-4a94-9006-57372f7c0e52","Type":"ContainerStarted","Data":"421830076e2ba2e5c7454e6475a0c383884f6dd9b77120f44260b556e3faeb2b"}
Jul 28 20:57:20.453178 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:20.453091    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c" event={"ID":"666ce654-e3f0-4a94-9006-57372f7c0e52","Type":"ContainerStarted","Data":"e1454b340055629b0927ffe9c6a211e5804eff6b1d81f4ced279f0bd790736a0"}
Jul 28 20:57:20.453178 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:20.453111    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"
Jul 28 20:57:20.467993 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:20.467947    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7" podStartSLOduration=1.467917348 podStartE2EDuration="1.467917348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:57:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:57:20.466620953 +0000 UTC m=+1954.711997655" watchObservedRunningTime="2026-07-28 20:57:20.467917348 +0000 UTC m=+1954.713294213"
Jul 28 20:57:20.484889 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:20.484839    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c" podStartSLOduration=1.484822745 podStartE2EDuration="1.484822745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:57:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:57:20.482851308 +0000 UTC m=+1954.728228011" watchObservedRunningTime="2026-07-28 20:57:20.484822745 +0000 UTC m=+1954.730199447"
Jul 28 20:57:28.412951 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:28.412904    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:57:31.459831 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:31.459800    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"
Jul 28 20:57:31.460241 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:57:31.459872    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"
Jul 28 20:58:01.889793 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:01.889698    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"]
Jul 28 20:58:01.890427 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:01.889970    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c" podUID="666ce654-e3f0-4a94-9006-57372f7c0e52" containerName="payload-processing" containerID="cri-o://421830076e2ba2e5c7454e6475a0c383884f6dd9b77120f44260b556e3faeb2b" gracePeriod=30
Jul 28 20:58:01.896057 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:01.896029    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"]
Jul 28 20:58:01.896288 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:01.896243    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7" podUID="92fdaf2a-69f9-46e6-9099-0ec9b1497cda" containerName="payload-pre-processing" containerID="cri-o://d8ac7a8edb4fb2b3e05cc3d42fc7a6b113b92b2511e2acaafa27e7a001916b11" gracePeriod=30
Jul 28 20:58:02.145038 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.144972    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"
Jul 28 20:58:02.171913 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.171885    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"
Jul 28 20:58:02.195192 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.195162    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92fdaf2a-69f9-46e6-9099-0ec9b1497cda-plugins-config-volume\") pod \"92fdaf2a-69f9-46e6-9099-0ec9b1497cda\" (UID: \"92fdaf2a-69f9-46e6-9099-0ec9b1497cda\") "
Jul 28 20:58:02.195347 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.195245    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhbhp\" (UniqueName: \"kubernetes.io/projected/92fdaf2a-69f9-46e6-9099-0ec9b1497cda-kube-api-access-bhbhp\") pod \"92fdaf2a-69f9-46e6-9099-0ec9b1497cda\" (UID: \"92fdaf2a-69f9-46e6-9099-0ec9b1497cda\") "
Jul 28 20:58:02.195347 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.195286    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqgv7\" (UniqueName: \"kubernetes.io/projected/666ce654-e3f0-4a94-9006-57372f7c0e52-kube-api-access-cqgv7\") pod \"666ce654-e3f0-4a94-9006-57372f7c0e52\" (UID: \"666ce654-e3f0-4a94-9006-57372f7c0e52\") "
Jul 28 20:58:02.195453 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.195378    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/666ce654-e3f0-4a94-9006-57372f7c0e52-plugins-config-volume\") pod \"666ce654-e3f0-4a94-9006-57372f7c0e52\" (UID: \"666ce654-e3f0-4a94-9006-57372f7c0e52\") "
Jul 28 20:58:02.195608 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.195576    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92fdaf2a-69f9-46e6-9099-0ec9b1497cda-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "92fdaf2a-69f9-46e6-9099-0ec9b1497cda" (UID: "92fdaf2a-69f9-46e6-9099-0ec9b1497cda"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:58:02.195768 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.195747    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92fdaf2a-69f9-46e6-9099-0ec9b1497cda-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:58:02.195862 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.195837    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/666ce654-e3f0-4a94-9006-57372f7c0e52-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "666ce654-e3f0-4a94-9006-57372f7c0e52" (UID: "666ce654-e3f0-4a94-9006-57372f7c0e52"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:58:02.197779 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.197759    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/666ce654-e3f0-4a94-9006-57372f7c0e52-kube-api-access-cqgv7" (OuterVolumeSpecName: "kube-api-access-cqgv7") pod "666ce654-e3f0-4a94-9006-57372f7c0e52" (UID: "666ce654-e3f0-4a94-9006-57372f7c0e52"). InnerVolumeSpecName "kube-api-access-cqgv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:58:02.197891 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.197784    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92fdaf2a-69f9-46e6-9099-0ec9b1497cda-kube-api-access-bhbhp" (OuterVolumeSpecName: "kube-api-access-bhbhp") pod "92fdaf2a-69f9-46e6-9099-0ec9b1497cda" (UID: "92fdaf2a-69f9-46e6-9099-0ec9b1497cda"). InnerVolumeSpecName "kube-api-access-bhbhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:58:02.301853 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.301816    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhbhp\" (UniqueName: \"kubernetes.io/projected/92fdaf2a-69f9-46e6-9099-0ec9b1497cda-kube-api-access-bhbhp\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:58:02.301853 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.301850    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqgv7\" (UniqueName: \"kubernetes.io/projected/666ce654-e3f0-4a94-9006-57372f7c0e52-kube-api-access-cqgv7\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:58:02.301853 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.301863    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/666ce654-e3f0-4a94-9006-57372f7c0e52-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:58:02.662258 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.662219    2555 generic.go:356] "Generic (PLEG): container finished" podID="92fdaf2a-69f9-46e6-9099-0ec9b1497cda" containerID="d8ac7a8edb4fb2b3e05cc3d42fc7a6b113b92b2511e2acaafa27e7a001916b11" exitCode=0
Jul 28 20:58:02.662436 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.662282    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"
Jul 28 20:58:02.662436 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.662303    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7" event={"ID":"92fdaf2a-69f9-46e6-9099-0ec9b1497cda","Type":"ContainerDied","Data":"d8ac7a8edb4fb2b3e05cc3d42fc7a6b113b92b2511e2acaafa27e7a001916b11"}
Jul 28 20:58:02.662436 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.662362    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7" event={"ID":"92fdaf2a-69f9-46e6-9099-0ec9b1497cda","Type":"ContainerDied","Data":"af8213338893606bec6d77a1eb0620c2f88fba850500bb55fdf16ae58b39bd5c"}
Jul 28 20:58:02.662436 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.662426    2555 scope.go:117] "RemoveContainer" containerID="d8ac7a8edb4fb2b3e05cc3d42fc7a6b113b92b2511e2acaafa27e7a001916b11"
Jul 28 20:58:02.663667 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.663632    2555 generic.go:356] "Generic (PLEG): container finished" podID="666ce654-e3f0-4a94-9006-57372f7c0e52" containerID="421830076e2ba2e5c7454e6475a0c383884f6dd9b77120f44260b556e3faeb2b" exitCode=0
Jul 28 20:58:02.663771 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.663695    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"
Jul 28 20:58:02.663835 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.663693    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c" event={"ID":"666ce654-e3f0-4a94-9006-57372f7c0e52","Type":"ContainerDied","Data":"421830076e2ba2e5c7454e6475a0c383884f6dd9b77120f44260b556e3faeb2b"}
Jul 28 20:58:02.663835 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.663812    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c" event={"ID":"666ce654-e3f0-4a94-9006-57372f7c0e52","Type":"ContainerDied","Data":"e1454b340055629b0927ffe9c6a211e5804eff6b1d81f4ced279f0bd790736a0"}
Jul 28 20:58:02.671278 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.671262    2555 scope.go:117] "RemoveContainer" containerID="d8ac7a8edb4fb2b3e05cc3d42fc7a6b113b92b2511e2acaafa27e7a001916b11"
Jul 28 20:58:02.671533 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:58:02.671517    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8ac7a8edb4fb2b3e05cc3d42fc7a6b113b92b2511e2acaafa27e7a001916b11\": container with ID starting with d8ac7a8edb4fb2b3e05cc3d42fc7a6b113b92b2511e2acaafa27e7a001916b11 not found: ID does not exist" containerID="d8ac7a8edb4fb2b3e05cc3d42fc7a6b113b92b2511e2acaafa27e7a001916b11"
Jul 28 20:58:02.671596 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.671540    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8ac7a8edb4fb2b3e05cc3d42fc7a6b113b92b2511e2acaafa27e7a001916b11"} err="failed to get container status \"d8ac7a8edb4fb2b3e05cc3d42fc7a6b113b92b2511e2acaafa27e7a001916b11\": rpc error: code = NotFound desc = could not find container \"d8ac7a8edb4fb2b3e05cc3d42fc7a6b113b92b2511e2acaafa27e7a001916b11\": container with ID starting with d8ac7a8edb4fb2b3e05cc3d42fc7a6b113b92b2511e2acaafa27e7a001916b11 not found: ID does not exist"
Jul 28 20:58:02.671596 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.671554    2555 scope.go:117] "RemoveContainer" containerID="421830076e2ba2e5c7454e6475a0c383884f6dd9b77120f44260b556e3faeb2b"
Jul 28 20:58:02.680746 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.680694    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"]
Jul 28 20:58:02.680837 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.680743    2555 scope.go:117] "RemoveContainer" containerID="421830076e2ba2e5c7454e6475a0c383884f6dd9b77120f44260b556e3faeb2b"
Jul 28 20:58:02.681192 ip-10-0-137-26 kubenswrapper[2555]: E0728 20:58:02.681170    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"421830076e2ba2e5c7454e6475a0c383884f6dd9b77120f44260b556e3faeb2b\": container with ID starting with 421830076e2ba2e5c7454e6475a0c383884f6dd9b77120f44260b556e3faeb2b not found: ID does not exist" containerID="421830076e2ba2e5c7454e6475a0c383884f6dd9b77120f44260b556e3faeb2b"
Jul 28 20:58:02.681274 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.681199    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"421830076e2ba2e5c7454e6475a0c383884f6dd9b77120f44260b556e3faeb2b"} err="failed to get container status \"421830076e2ba2e5c7454e6475a0c383884f6dd9b77120f44260b556e3faeb2b\": rpc error: code = NotFound desc = could not find container \"421830076e2ba2e5c7454e6475a0c383884f6dd9b77120f44260b556e3faeb2b\": container with ID starting with 421830076e2ba2e5c7454e6475a0c383884f6dd9b77120f44260b556e3faeb2b not found: ID does not exist"
Jul 28 20:58:02.682600 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.682584    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2c06c6bc-6bbff8bcdb-lfs9c"]
Jul 28 20:58:02.690531 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.690512    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"]
Jul 28 20:58:02.695131 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:02.695112    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2c06c6bc-5468bbbc8d-28jn7"]
Jul 28 20:58:04.296091 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:04.296058    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="666ce654-e3f0-4a94-9006-57372f7c0e52" path="/var/lib/kubelet/pods/666ce654-e3f0-4a94-9006-57372f7c0e52/volumes"
Jul 28 20:58:04.296483 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:04.296434    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92fdaf2a-69f9-46e6-9099-0ec9b1497cda" path="/var/lib/kubelet/pods/92fdaf2a-69f9-46e6-9099-0ec9b1497cda/volumes"
Jul 28 20:58:04.603359 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:04.603318    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:58:34.307839 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.307799    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"]
Jul 28 20:58:34.308350 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.308166    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="666ce654-e3f0-4a94-9006-57372f7c0e52" containerName="payload-processing"
Jul 28 20:58:34.308350 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.308177    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="666ce654-e3f0-4a94-9006-57372f7c0e52" containerName="payload-processing"
Jul 28 20:58:34.308350 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.308196    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92fdaf2a-69f9-46e6-9099-0ec9b1497cda" containerName="payload-pre-processing"
Jul 28 20:58:34.308350 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.308202    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="92fdaf2a-69f9-46e6-9099-0ec9b1497cda" containerName="payload-pre-processing"
Jul 28 20:58:34.308350 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.308268    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="666ce654-e3f0-4a94-9006-57372f7c0e52" containerName="payload-processing"
Jul 28 20:58:34.308350 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.308278    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="92fdaf2a-69f9-46e6-9099-0ec9b1497cda" containerName="payload-pre-processing"
Jul 28 20:58:34.310885 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.310869    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"
Jul 28 20:58:34.313809 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.313786    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a8387f77\""
Jul 28 20:58:34.313982 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.313843    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a8387f77-dockercfg-wppkp\""
Jul 28 20:58:34.329731 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.329708    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"]
Jul 28 20:58:34.358697 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.358666    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"]
Jul 28 20:58:34.361989 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.361973    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"
Jul 28 20:58:34.369997 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.369968    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"]
Jul 28 20:58:34.490321 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.490281    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d01711d-bf3a-43df-8311-7bacc5af17de-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv\" (UID: \"1d01711d-bf3a-43df-8311-7bacc5af17de\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"
Jul 28 20:58:34.490534 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.490371    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wqs4\" (UniqueName: \"kubernetes.io/projected/f7b750c1-2b1f-495f-ad24-05213f1aa0fd-kube-api-access-8wqs4\") pod \"payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46\" (UID: \"f7b750c1-2b1f-495f-ad24-05213f1aa0fd\") " pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"
Jul 28 20:58:34.490534 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.490407    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcfld\" (UniqueName: \"kubernetes.io/projected/1d01711d-bf3a-43df-8311-7bacc5af17de-kube-api-access-fcfld\") pod \"payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv\" (UID: \"1d01711d-bf3a-43df-8311-7bacc5af17de\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"
Jul 28 20:58:34.490534 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.490498    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7b750c1-2b1f-495f-ad24-05213f1aa0fd-plugins-config-volume\") pod \"payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46\" (UID: \"f7b750c1-2b1f-495f-ad24-05213f1aa0fd\") " pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"
Jul 28 20:58:34.591308 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.591262    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d01711d-bf3a-43df-8311-7bacc5af17de-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv\" (UID: \"1d01711d-bf3a-43df-8311-7bacc5af17de\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"
Jul 28 20:58:34.591507 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.591343    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wqs4\" (UniqueName: \"kubernetes.io/projected/f7b750c1-2b1f-495f-ad24-05213f1aa0fd-kube-api-access-8wqs4\") pod \"payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46\" (UID: \"f7b750c1-2b1f-495f-ad24-05213f1aa0fd\") " pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"
Jul 28 20:58:34.591507 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.591366    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcfld\" (UniqueName: \"kubernetes.io/projected/1d01711d-bf3a-43df-8311-7bacc5af17de-kube-api-access-fcfld\") pod \"payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv\" (UID: \"1d01711d-bf3a-43df-8311-7bacc5af17de\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"
Jul 28 20:58:34.591507 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.591399    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7b750c1-2b1f-495f-ad24-05213f1aa0fd-plugins-config-volume\") pod \"payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46\" (UID: \"f7b750c1-2b1f-495f-ad24-05213f1aa0fd\") " pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"
Jul 28 20:58:34.592041 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.592008    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d01711d-bf3a-43df-8311-7bacc5af17de-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv\" (UID: \"1d01711d-bf3a-43df-8311-7bacc5af17de\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"
Jul 28 20:58:34.592221 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.592203    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7b750c1-2b1f-495f-ad24-05213f1aa0fd-plugins-config-volume\") pod \"payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46\" (UID: \"f7b750c1-2b1f-495f-ad24-05213f1aa0fd\") " pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"
Jul 28 20:58:34.601994 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.601971    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcfld\" (UniqueName: \"kubernetes.io/projected/1d01711d-bf3a-43df-8311-7bacc5af17de-kube-api-access-fcfld\") pod \"payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv\" (UID: \"1d01711d-bf3a-43df-8311-7bacc5af17de\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"
Jul 28 20:58:34.602109 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.602021    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wqs4\" (UniqueName: \"kubernetes.io/projected/f7b750c1-2b1f-495f-ad24-05213f1aa0fd-kube-api-access-8wqs4\") pod \"payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46\" (UID: \"f7b750c1-2b1f-495f-ad24-05213f1aa0fd\") " pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"
Jul 28 20:58:34.621668 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.621636    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"
Jul 28 20:58:34.672664 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.672618    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"
Jul 28 20:58:34.772177 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.772144    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"]
Jul 28 20:58:34.774794 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:58:34.774751    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d01711d_bf3a_43df_8311_7bacc5af17de.slice/crio-a9a0e137f813cb72b67e92ce02407d22634445f8c1d4bcf775c185913c8a69e0 WatchSource:0}: Error finding container a9a0e137f813cb72b67e92ce02407d22634445f8c1d4bcf775c185913c8a69e0: Status 404 returned error can't find the container with id a9a0e137f813cb72b67e92ce02407d22634445f8c1d4bcf775c185913c8a69e0
Jul 28 20:58:34.820516 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.820476    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv" event={"ID":"1d01711d-bf3a-43df-8311-7bacc5af17de","Type":"ContainerStarted","Data":"a9a0e137f813cb72b67e92ce02407d22634445f8c1d4bcf775c185913c8a69e0"}
Jul 28 20:58:34.829025 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:34.829002    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"]
Jul 28 20:58:34.833014 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:58:34.832991    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b750c1_2b1f_495f_ad24_05213f1aa0fd.slice/crio-81c60f08bd803c795445b3b9d9b11e3505620e7afdbfcc908b16cddcb27bfad9 WatchSource:0}: Error finding container 81c60f08bd803c795445b3b9d9b11e3505620e7afdbfcc908b16cddcb27bfad9: Status 404 returned error can't find the container with id 81c60f08bd803c795445b3b9d9b11e3505620e7afdbfcc908b16cddcb27bfad9
Jul 28 20:58:35.828526 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:35.828484    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46" event={"ID":"f7b750c1-2b1f-495f-ad24-05213f1aa0fd","Type":"ContainerStarted","Data":"c132fab500e3abe1dbe6f0b8b9929e02628c0b96c385a131ce71a69a1252c473"}
Jul 28 20:58:35.829006 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:35.828551    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46" event={"ID":"f7b750c1-2b1f-495f-ad24-05213f1aa0fd","Type":"ContainerStarted","Data":"81c60f08bd803c795445b3b9d9b11e3505620e7afdbfcc908b16cddcb27bfad9"}
Jul 28 20:58:35.829006 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:35.828578    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"
Jul 28 20:58:35.830141 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:35.830114    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv" event={"ID":"1d01711d-bf3a-43df-8311-7bacc5af17de","Type":"ContainerStarted","Data":"f007771ac987ed1a7ffd3803e94a68dc470771ad074d84f613ebc5d1438f224c"}
Jul 28 20:58:35.830269 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:35.830177    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"
Jul 28 20:58:35.845990 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:35.845947    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46" podStartSLOduration=1.845918367 podStartE2EDuration="1.845918367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:58:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:58:35.84526953 +0000 UTC m=+2030.090646235" watchObservedRunningTime="2026-07-28 20:58:35.845918367 +0000 UTC m=+2030.091295071"
Jul 28 20:58:35.861650 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:35.861599    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv" podStartSLOduration=1.861583406 podStartE2EDuration="1.861583406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:58:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:58:35.86037706 +0000 UTC m=+2030.105753761" watchObservedRunningTime="2026-07-28 20:58:35.861583406 +0000 UTC m=+2030.106960108"
Jul 28 20:58:39.396922 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:39.396883    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:58:46.836266 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:46.836238    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"
Jul 28 20:58:46.836781 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:58:46.836352    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"
Jul 28 20:59:08.905531 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:08.905450    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"]
Jul 28 20:59:08.909161 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:08.909142    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:08.912404 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:08.912378    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a8387f77\"/\"openshift-service-ca.crt\""
Jul 28 20:59:08.912533 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:08.912377    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a8387f77\"/\"default-dockercfg-n8622\""
Jul 28 20:59:08.912533 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:08.912380    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a8387f77\"/\"e2e-lifecycle-model-a8387f77-kserve-self-signed-certs\""
Jul 28 20:59:08.912533 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:08.912413    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a8387f77\"/\"kube-root-ca.crt\""
Jul 28 20:59:08.920920 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:08.920896    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"]
Jul 28 20:59:08.974998 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:08.974966    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-model-cache\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:08.974998 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:08.975002    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-home\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:08.975214 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:08.975025    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c18a999-7977-4a1e-9ca8-36a277c4cfad-tls-certs\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:08.975214 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:08.975076    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-tmp-dir\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:08.975214 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:08.975148    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dqzl\" (UniqueName: \"kubernetes.io/projected/2c18a999-7977-4a1e-9ca8-36a277c4cfad-kube-api-access-8dqzl\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:08.975319 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:08.975227    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-dshm\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:09.076408 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:09.076372    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-home\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:09.076556 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:09.076418    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c18a999-7977-4a1e-9ca8-36a277c4cfad-tls-certs\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:09.076556 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:09.076473    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-tmp-dir\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:09.076556 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:09.076493    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dqzl\" (UniqueName: \"kubernetes.io/projected/2c18a999-7977-4a1e-9ca8-36a277c4cfad-kube-api-access-8dqzl\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:09.076728 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:09.076560    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-dshm\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:09.076728 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:09.076587    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-model-cache\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:09.076913 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:09.076879    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-home\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:09.077017 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:09.076920    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-tmp-dir\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:09.077017 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:09.076964    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-model-cache\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:09.078730 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:09.078703    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-dshm\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:09.079162 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:09.079141    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c18a999-7977-4a1e-9ca8-36a277c4cfad-tls-certs\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:09.085327 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:09.085304    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dqzl\" (UniqueName: \"kubernetes.io/projected/2c18a999-7977-4a1e-9ca8-36a277c4cfad-kube-api-access-8dqzl\") pod \"e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") " pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:09.218385 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:09.218290    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:09.354860 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:09.354833    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"]
Jul 28 20:59:09.357306 ip-10-0-137-26 kubenswrapper[2555]: W0728 20:59:09.357278    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c18a999_7977_4a1e_9ca8_36a277c4cfad.slice/crio-981fc4ff06d3a296111f2f7de70e505678b9a4fdbda5806495fbf313e049b700 WatchSource:0}: Error finding container 981fc4ff06d3a296111f2f7de70e505678b9a4fdbda5806495fbf313e049b700: Status 404 returned error can't find the container with id 981fc4ff06d3a296111f2f7de70e505678b9a4fdbda5806495fbf313e049b700
Jul 28 20:59:09.995499 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:09.995457    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph" event={"ID":"2c18a999-7977-4a1e-9ca8-36a277c4cfad","Type":"ContainerStarted","Data":"f223d5b0340d3023704654e53a5eb743a74eba37b1119272b6fed471fe7d77ce"}
Jul 28 20:59:09.995499 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:09.995499    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph" event={"ID":"2c18a999-7977-4a1e-9ca8-36a277c4cfad","Type":"ContainerStarted","Data":"981fc4ff06d3a296111f2f7de70e505678b9a4fdbda5806495fbf313e049b700"}
Jul 28 20:59:10.013054 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:10.013008    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph" podStartSLOduration=2.012993477 podStartE2EDuration="2.012993477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:59:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:59:10.011237665 +0000 UTC m=+2064.256614410" watchObservedRunningTime="2026-07-28 20:59:10.012993477 +0000 UTC m=+2064.258370211"
Jul 28 20:59:12.210365 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:12.210327    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:59:19.218462 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:19.218421    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:19.218979 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:19.218484    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:19.231175 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:19.231147    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:20.060207 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:20.060180    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 20:59:28.508747 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:28.508708    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:59:46.383597 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:46.383567    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:59:46.387795 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:46.387770    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 20:59:47.801515 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:47.801478    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:59:49.036087 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.036050    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"]
Jul 28 20:59:49.036558 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.036300    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46" podUID="f7b750c1-2b1f-495f-ad24-05213f1aa0fd" containerName="payload-processing" containerID="cri-o://c132fab500e3abe1dbe6f0b8b9929e02628c0b96c385a131ce71a69a1252c473" gracePeriod=30
Jul 28 20:59:49.040211 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.040188    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"]
Jul 28 20:59:49.040617 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.040580    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv" podUID="1d01711d-bf3a-43df-8311-7bacc5af17de" containerName="payload-pre-processing" containerID="cri-o://f007771ac987ed1a7ffd3803e94a68dc470771ad074d84f613ebc5d1438f224c" gracePeriod=30
Jul 28 20:59:49.195894 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.195795    2555 generic.go:356] "Generic (PLEG): container finished" podID="f7b750c1-2b1f-495f-ad24-05213f1aa0fd" containerID="c132fab500e3abe1dbe6f0b8b9929e02628c0b96c385a131ce71a69a1252c473" exitCode=0
Jul 28 20:59:49.196110 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.195886    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46" event={"ID":"f7b750c1-2b1f-495f-ad24-05213f1aa0fd","Type":"ContainerDied","Data":"c132fab500e3abe1dbe6f0b8b9929e02628c0b96c385a131ce71a69a1252c473"}
Jul 28 20:59:49.197541 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.197520    2555 generic.go:356] "Generic (PLEG): container finished" podID="1d01711d-bf3a-43df-8311-7bacc5af17de" containerID="f007771ac987ed1a7ffd3803e94a68dc470771ad074d84f613ebc5d1438f224c" exitCode=0
Jul 28 20:59:49.197670 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.197653    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv" event={"ID":"1d01711d-bf3a-43df-8311-7bacc5af17de","Type":"ContainerDied","Data":"f007771ac987ed1a7ffd3803e94a68dc470771ad074d84f613ebc5d1438f224c"}
Jul 28 20:59:49.304047 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.303987    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"
Jul 28 20:59:49.324832 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.324804    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"
Jul 28 20:59:49.337848 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.337822    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcfld\" (UniqueName: \"kubernetes.io/projected/1d01711d-bf3a-43df-8311-7bacc5af17de-kube-api-access-fcfld\") pod \"1d01711d-bf3a-43df-8311-7bacc5af17de\" (UID: \"1d01711d-bf3a-43df-8311-7bacc5af17de\") "
Jul 28 20:59:49.338013 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.337857    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7b750c1-2b1f-495f-ad24-05213f1aa0fd-plugins-config-volume\") pod \"f7b750c1-2b1f-495f-ad24-05213f1aa0fd\" (UID: \"f7b750c1-2b1f-495f-ad24-05213f1aa0fd\") "
Jul 28 20:59:49.338571 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.338270    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7b750c1-2b1f-495f-ad24-05213f1aa0fd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f7b750c1-2b1f-495f-ad24-05213f1aa0fd" (UID: "f7b750c1-2b1f-495f-ad24-05213f1aa0fd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:59:49.340396 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.340318    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d01711d-bf3a-43df-8311-7bacc5af17de-kube-api-access-fcfld" (OuterVolumeSpecName: "kube-api-access-fcfld") pod "1d01711d-bf3a-43df-8311-7bacc5af17de" (UID: "1d01711d-bf3a-43df-8311-7bacc5af17de"). InnerVolumeSpecName "kube-api-access-fcfld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:59:49.438680 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.438632    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d01711d-bf3a-43df-8311-7bacc5af17de-plugins-config-volume\") pod \"1d01711d-bf3a-43df-8311-7bacc5af17de\" (UID: \"1d01711d-bf3a-43df-8311-7bacc5af17de\") "
Jul 28 20:59:49.438856 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.438698    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wqs4\" (UniqueName: \"kubernetes.io/projected/f7b750c1-2b1f-495f-ad24-05213f1aa0fd-kube-api-access-8wqs4\") pod \"f7b750c1-2b1f-495f-ad24-05213f1aa0fd\" (UID: \"f7b750c1-2b1f-495f-ad24-05213f1aa0fd\") "
Jul 28 20:59:49.438996 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.438971    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d01711d-bf3a-43df-8311-7bacc5af17de-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1d01711d-bf3a-43df-8311-7bacc5af17de" (UID: "1d01711d-bf3a-43df-8311-7bacc5af17de"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:59:49.439060 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.439006    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcfld\" (UniqueName: \"kubernetes.io/projected/1d01711d-bf3a-43df-8311-7bacc5af17de-kube-api-access-fcfld\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:59:49.439060 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.439028    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7b750c1-2b1f-495f-ad24-05213f1aa0fd-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:59:49.440716 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.440694    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b750c1-2b1f-495f-ad24-05213f1aa0fd-kube-api-access-8wqs4" (OuterVolumeSpecName: "kube-api-access-8wqs4") pod "f7b750c1-2b1f-495f-ad24-05213f1aa0fd" (UID: "f7b750c1-2b1f-495f-ad24-05213f1aa0fd"). InnerVolumeSpecName "kube-api-access-8wqs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:59:49.540284 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.540236    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d01711d-bf3a-43df-8311-7bacc5af17de-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:59:49.540284 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:49.540281    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wqs4\" (UniqueName: \"kubernetes.io/projected/f7b750c1-2b1f-495f-ad24-05213f1aa0fd-kube-api-access-8wqs4\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 20:59:50.204567 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:50.204530    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46" event={"ID":"f7b750c1-2b1f-495f-ad24-05213f1aa0fd","Type":"ContainerDied","Data":"81c60f08bd803c795445b3b9d9b11e3505620e7afdbfcc908b16cddcb27bfad9"}
Jul 28 20:59:50.205049 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:50.204598    2555 scope.go:117] "RemoveContainer" containerID="c132fab500e3abe1dbe6f0b8b9929e02628c0b96c385a131ce71a69a1252c473"
Jul 28 20:59:50.205049 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:50.204538    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"
Jul 28 20:59:50.205977 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:50.205891    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv" event={"ID":"1d01711d-bf3a-43df-8311-7bacc5af17de","Type":"ContainerDied","Data":"a9a0e137f813cb72b67e92ce02407d22634445f8c1d4bcf775c185913c8a69e0"}
Jul 28 20:59:50.205977 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:50.205918    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"
Jul 28 20:59:50.213850 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:50.213827    2555 scope.go:117] "RemoveContainer" containerID="f007771ac987ed1a7ffd3803e94a68dc470771ad074d84f613ebc5d1438f224c"
Jul 28 20:59:50.228803 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:50.228780    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"]
Jul 28 20:59:50.234528 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:50.234504    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a8387f77-5c475d68fd-jwl46"]
Jul 28 20:59:50.243220 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:50.243198    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"]
Jul 28 20:59:50.250118 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:50.250096    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a8387f77-647f8f86b8-zk2fv"]
Jul 28 20:59:50.295762 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:50.295731    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d01711d-bf3a-43df-8311-7bacc5af17de" path="/var/lib/kubelet/pods/1d01711d-bf3a-43df-8311-7bacc5af17de/volumes"
Jul 28 20:59:50.296121 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:50.296108    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7b750c1-2b1f-495f-ad24-05213f1aa0fd" path="/var/lib/kubelet/pods/f7b750c1-2b1f-495f-ad24-05213f1aa0fd/volumes"
Jul 28 20:59:56.838065 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:56.838028    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 20:59:57.626305 ip-10-0-137-26 kubenswrapper[2555]: I0728 20:59:57.626266    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"]
Jul 28 21:00:12.645385 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:12.645339    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph" podUID="2c18a999-7977-4a1e-9ca8-36a277c4cfad" containerName="main" containerID="cri-o://f223d5b0340d3023704654e53a5eb743a74eba37b1119272b6fed471fe7d77ce" gracePeriod=45
Jul 28 21:00:12.905200 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:12.905139    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 21:00:13.054550 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.054501    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-dshm\") pod \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") "
Jul 28 21:00:13.054731 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.054572    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dqzl\" (UniqueName: \"kubernetes.io/projected/2c18a999-7977-4a1e-9ca8-36a277c4cfad-kube-api-access-8dqzl\") pod \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") "
Jul 28 21:00:13.054731 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.054597    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-home\") pod \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") "
Jul 28 21:00:13.054731 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.054643    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c18a999-7977-4a1e-9ca8-36a277c4cfad-tls-certs\") pod \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") "
Jul 28 21:00:13.054731 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.054704    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-tmp-dir\") pod \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") "
Jul 28 21:00:13.054957 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.054738    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-model-cache\") pod \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\" (UID: \"2c18a999-7977-4a1e-9ca8-36a277c4cfad\") "
Jul 28 21:00:13.054957 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.054893    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-home" (OuterVolumeSpecName: "home") pod "2c18a999-7977-4a1e-9ca8-36a277c4cfad" (UID: "2c18a999-7977-4a1e-9ca8-36a277c4cfad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:00:13.055095 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.054998    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2c18a999-7977-4a1e-9ca8-36a277c4cfad" (UID: "2c18a999-7977-4a1e-9ca8-36a277c4cfad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:00:13.055153 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.055100    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-model-cache" (OuterVolumeSpecName: "model-cache") pod "2c18a999-7977-4a1e-9ca8-36a277c4cfad" (UID: "2c18a999-7977-4a1e-9ca8-36a277c4cfad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:00:13.055208 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.055187    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-tmp-dir\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:00:13.055262 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.055206    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-model-cache\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:00:13.055262 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.055222    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-home\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:00:13.056817 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.056794    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-dshm" (OuterVolumeSpecName: "dshm") pod "2c18a999-7977-4a1e-9ca8-36a277c4cfad" (UID: "2c18a999-7977-4a1e-9ca8-36a277c4cfad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:00:13.056907 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.056835    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c18a999-7977-4a1e-9ca8-36a277c4cfad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2c18a999-7977-4a1e-9ca8-36a277c4cfad" (UID: "2c18a999-7977-4a1e-9ca8-36a277c4cfad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:00:13.056966 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.056920    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c18a999-7977-4a1e-9ca8-36a277c4cfad-kube-api-access-8dqzl" (OuterVolumeSpecName: "kube-api-access-8dqzl") pod "2c18a999-7977-4a1e-9ca8-36a277c4cfad" (UID: "2c18a999-7977-4a1e-9ca8-36a277c4cfad"). InnerVolumeSpecName "kube-api-access-8dqzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:00:13.156420 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.156337    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c18a999-7977-4a1e-9ca8-36a277c4cfad-dshm\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:00:13.156420 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.156367    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dqzl\" (UniqueName: \"kubernetes.io/projected/2c18a999-7977-4a1e-9ca8-36a277c4cfad-kube-api-access-8dqzl\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:00:13.156420 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.156378    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c18a999-7977-4a1e-9ca8-36a277c4cfad-tls-certs\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:00:13.316830 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.316798    2555 generic.go:356] "Generic (PLEG): container finished" podID="2c18a999-7977-4a1e-9ca8-36a277c4cfad" containerID="f223d5b0340d3023704654e53a5eb743a74eba37b1119272b6fed471fe7d77ce" exitCode=0
Jul 28 21:00:13.317074 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.316837    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"
Jul 28 21:00:13.317074 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.316891    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph" event={"ID":"2c18a999-7977-4a1e-9ca8-36a277c4cfad","Type":"ContainerDied","Data":"f223d5b0340d3023704654e53a5eb743a74eba37b1119272b6fed471fe7d77ce"}
Jul 28 21:00:13.317074 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.316961    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph" event={"ID":"2c18a999-7977-4a1e-9ca8-36a277c4cfad","Type":"ContainerDied","Data":"981fc4ff06d3a296111f2f7de70e505678b9a4fdbda5806495fbf313e049b700"}
Jul 28 21:00:13.317074 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.316987    2555 scope.go:117] "RemoveContainer" containerID="f223d5b0340d3023704654e53a5eb743a74eba37b1119272b6fed471fe7d77ce"
Jul 28 21:00:13.326222 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.326206    2555 scope.go:117] "RemoveContainer" containerID="f223d5b0340d3023704654e53a5eb743a74eba37b1119272b6fed471fe7d77ce"
Jul 28 21:00:13.326488 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:00:13.326469    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f223d5b0340d3023704654e53a5eb743a74eba37b1119272b6fed471fe7d77ce\": container with ID starting with f223d5b0340d3023704654e53a5eb743a74eba37b1119272b6fed471fe7d77ce not found: ID does not exist" containerID="f223d5b0340d3023704654e53a5eb743a74eba37b1119272b6fed471fe7d77ce"
Jul 28 21:00:13.326541 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.326496    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f223d5b0340d3023704654e53a5eb743a74eba37b1119272b6fed471fe7d77ce"} err="failed to get container status \"f223d5b0340d3023704654e53a5eb743a74eba37b1119272b6fed471fe7d77ce\": rpc error: code = NotFound desc = could not find container \"f223d5b0340d3023704654e53a5eb743a74eba37b1119272b6fed471fe7d77ce\": container with ID starting with f223d5b0340d3023704654e53a5eb743a74eba37b1119272b6fed471fe7d77ce not found: ID does not exist"
Jul 28 21:00:13.338300 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.338277    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"]
Jul 28 21:00:13.341902 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:13.341882    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-a8387f77/e2e-lifecycle-model-a8387f77-kserve-85f766b467-6gnph"]
Jul 28 21:00:14.295892 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:14.295859    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c18a999-7977-4a1e-9ca8-36a277c4cfad" path="/var/lib/kubelet/pods/2c18a999-7977-4a1e-9ca8-36a277c4cfad/volumes"
Jul 28 21:00:44.616074 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:44.615987    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:00:57.616252 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:00:57.616212    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:01:41.778116 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.778075    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"]
Jul 28 21:01:41.778736 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.778598    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c18a999-7977-4a1e-9ca8-36a277c4cfad" containerName="main"
Jul 28 21:01:41.778736 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.778618    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c18a999-7977-4a1e-9ca8-36a277c4cfad" containerName="main"
Jul 28 21:01:41.778736 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.778637    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7b750c1-2b1f-495f-ad24-05213f1aa0fd" containerName="payload-processing"
Jul 28 21:01:41.778736 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.778646    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b750c1-2b1f-495f-ad24-05213f1aa0fd" containerName="payload-processing"
Jul 28 21:01:41.778736 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.778680    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d01711d-bf3a-43df-8311-7bacc5af17de" containerName="payload-pre-processing"
Jul 28 21:01:41.778736 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.778689    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d01711d-bf3a-43df-8311-7bacc5af17de" containerName="payload-pre-processing"
Jul 28 21:01:41.779087 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.778767    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d01711d-bf3a-43df-8311-7bacc5af17de" containerName="payload-pre-processing"
Jul 28 21:01:41.779087 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.778781    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7b750c1-2b1f-495f-ad24-05213f1aa0fd" containerName="payload-processing"
Jul 28 21:01:41.779087 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.778795    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c18a999-7977-4a1e-9ca8-36a277c4cfad" containerName="main"
Jul 28 21:01:41.781947 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.781915    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"
Jul 28 21:01:41.784277 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.784257    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-7465ef\""
Jul 28 21:01:41.784390 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.784265    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-7465ef-dockercfg-jwzrr\""
Jul 28 21:01:41.792798 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.792772    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"]
Jul 28 21:01:41.801279 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.801251    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"]
Jul 28 21:01:41.805186 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.805166    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"
Jul 28 21:01:41.829786 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.829754    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"]
Jul 28 21:01:41.839324 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.839296    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55637d4e-4dda-4f53-9fef-05bd82aab83c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl\" (UID: \"55637d4e-4dda-4f53-9fef-05bd82aab83c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"
Jul 28 21:01:41.839492 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.839346    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27jcx\" (UniqueName: \"kubernetes.io/projected/55637d4e-4dda-4f53-9fef-05bd82aab83c-kube-api-access-27jcx\") pod \"payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl\" (UID: \"55637d4e-4dda-4f53-9fef-05bd82aab83c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"
Jul 28 21:01:41.839492 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.839371    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac16ebfb-2f04-4dee-8180-24511716c0cc-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487\" (UID: \"ac16ebfb-2f04-4dee-8180-24511716c0cc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"
Jul 28 21:01:41.839492 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.839438    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sddj8\" (UniqueName: \"kubernetes.io/projected/ac16ebfb-2f04-4dee-8180-24511716c0cc-kube-api-access-sddj8\") pod \"payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487\" (UID: \"ac16ebfb-2f04-4dee-8180-24511716c0cc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"
Jul 28 21:01:41.940791 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.940751    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sddj8\" (UniqueName: \"kubernetes.io/projected/ac16ebfb-2f04-4dee-8180-24511716c0cc-kube-api-access-sddj8\") pod \"payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487\" (UID: \"ac16ebfb-2f04-4dee-8180-24511716c0cc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"
Jul 28 21:01:41.941027 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.940826    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55637d4e-4dda-4f53-9fef-05bd82aab83c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl\" (UID: \"55637d4e-4dda-4f53-9fef-05bd82aab83c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"
Jul 28 21:01:41.941027 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.940858    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27jcx\" (UniqueName: \"kubernetes.io/projected/55637d4e-4dda-4f53-9fef-05bd82aab83c-kube-api-access-27jcx\") pod \"payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl\" (UID: \"55637d4e-4dda-4f53-9fef-05bd82aab83c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"
Jul 28 21:01:41.941027 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.940875    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac16ebfb-2f04-4dee-8180-24511716c0cc-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487\" (UID: \"ac16ebfb-2f04-4dee-8180-24511716c0cc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"
Jul 28 21:01:41.941585 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.941561    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac16ebfb-2f04-4dee-8180-24511716c0cc-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487\" (UID: \"ac16ebfb-2f04-4dee-8180-24511716c0cc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"
Jul 28 21:01:41.941672 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.941601    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55637d4e-4dda-4f53-9fef-05bd82aab83c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl\" (UID: \"55637d4e-4dda-4f53-9fef-05bd82aab83c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"
Jul 28 21:01:41.950445 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.950414    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27jcx\" (UniqueName: \"kubernetes.io/projected/55637d4e-4dda-4f53-9fef-05bd82aab83c-kube-api-access-27jcx\") pod \"payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl\" (UID: \"55637d4e-4dda-4f53-9fef-05bd82aab83c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"
Jul 28 21:01:41.950445 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:41.950431    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sddj8\" (UniqueName: \"kubernetes.io/projected/ac16ebfb-2f04-4dee-8180-24511716c0cc-kube-api-access-sddj8\") pod \"payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487\" (UID: \"ac16ebfb-2f04-4dee-8180-24511716c0cc\") " pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"
Jul 28 21:01:42.093340 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:42.093308    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"
Jul 28 21:01:42.114649 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:42.114619    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"
Jul 28 21:01:42.292908 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:01:42.292877    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac16ebfb_2f04_4dee_8180_24511716c0cc.slice/crio-c89ddee8f3e46131cdc7866919f3c20936bb3bc2808819c2e1ab0e7854ab6898 WatchSource:0}: Error finding container c89ddee8f3e46131cdc7866919f3c20936bb3bc2808819c2e1ab0e7854ab6898: Status 404 returned error can't find the container with id c89ddee8f3e46131cdc7866919f3c20936bb3bc2808819c2e1ab0e7854ab6898
Jul 28 21:01:42.296305 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:42.296280    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"]
Jul 28 21:01:42.447105 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:42.447077    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"]
Jul 28 21:01:42.449126 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:01:42.449091    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55637d4e_4dda_4f53_9fef_05bd82aab83c.slice/crio-a167cf34a4e2ca41ba5bbf10454eb781382318559e5f2c8d6226671225cb89d8 WatchSource:0}: Error finding container a167cf34a4e2ca41ba5bbf10454eb781382318559e5f2c8d6226671225cb89d8: Status 404 returned error can't find the container with id a167cf34a4e2ca41ba5bbf10454eb781382318559e5f2c8d6226671225cb89d8
Jul 28 21:01:42.731163 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:42.731060    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487" event={"ID":"ac16ebfb-2f04-4dee-8180-24511716c0cc","Type":"ContainerStarted","Data":"3dee16878b54fb097d74c3476bd1f16666e235a157f924ac71ba6a395db1e24a"}
Jul 28 21:01:42.731163 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:42.731117    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487" event={"ID":"ac16ebfb-2f04-4dee-8180-24511716c0cc","Type":"ContainerStarted","Data":"c89ddee8f3e46131cdc7866919f3c20936bb3bc2808819c2e1ab0e7854ab6898"}
Jul 28 21:01:42.731407 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:42.731171    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"
Jul 28 21:01:42.732656 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:42.732626    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl" event={"ID":"55637d4e-4dda-4f53-9fef-05bd82aab83c","Type":"ContainerStarted","Data":"3c1484539d8883cae7a475a77a23c1cc9a0735bb9cbdcbb33738391153961d84"}
Jul 28 21:01:42.732793 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:42.732675    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl" event={"ID":"55637d4e-4dda-4f53-9fef-05bd82aab83c","Type":"ContainerStarted","Data":"a167cf34a4e2ca41ba5bbf10454eb781382318559e5f2c8d6226671225cb89d8"}
Jul 28 21:01:42.732793 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:42.732739    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"
Jul 28 21:01:42.761895 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:42.761847    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487" podStartSLOduration=1.761832732 podStartE2EDuration="1.761832732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:01:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:01:42.746499303 +0000 UTC m=+2216.991876004" watchObservedRunningTime="2026-07-28 21:01:42.761832732 +0000 UTC m=+2217.007209433"
Jul 28 21:01:42.762227 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:42.762203    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl" podStartSLOduration=1.7621959010000001 podStartE2EDuration="1.762195901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:01:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:01:42.761109798 +0000 UTC m=+2217.006486499" watchObservedRunningTime="2026-07-28 21:01:42.762195901 +0000 UTC m=+2217.007572602"
Jul 28 21:01:46.490543 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:46.490506    2555 scope.go:117] "RemoveContainer" containerID="e08dafc93ee72ef3500d63085f3b76fb36568e859e6231b33d3cd5b9a96f74cc"
Jul 28 21:01:46.805842 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:46.805755    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:01:53.739408 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:53.739366    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"
Jul 28 21:01:53.739991 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:01:53.739501    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"
Jul 28 21:02:10.771988 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:10.771883    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"]
Jul 28 21:02:10.775468 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:10.775450    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"
Jul 28 21:02:10.778541 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:10.778520    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-3d8bda\""
Jul 28 21:02:10.778666 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:10.778578    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-3d8bda-dockercfg-lrtdp\""
Jul 28 21:02:10.788130 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:10.788107    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"]
Jul 28 21:02:10.802851 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:10.802830    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl676\" (UniqueName: \"kubernetes.io/projected/0b086f8a-7029-4587-a03b-333a11229485-kube-api-access-sl676\") pod \"payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs\" (UID: \"0b086f8a-7029-4587-a03b-333a11229485\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"
Jul 28 21:02:10.802986 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:10.802883    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b086f8a-7029-4587-a03b-333a11229485-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs\" (UID: \"0b086f8a-7029-4587-a03b-333a11229485\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"
Jul 28 21:02:10.816365 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:10.816333    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"]
Jul 28 21:02:10.819640 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:10.819620    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"
Jul 28 21:02:10.830104 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:10.830083    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"]
Jul 28 21:02:10.904206 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:10.904173    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl676\" (UniqueName: \"kubernetes.io/projected/0b086f8a-7029-4587-a03b-333a11229485-kube-api-access-sl676\") pod \"payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs\" (UID: \"0b086f8a-7029-4587-a03b-333a11229485\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"
Jul 28 21:02:10.904206 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:10.904211    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bhm2\" (UniqueName: \"kubernetes.io/projected/4e1cade8-00f7-4282-9247-39784df16d09-kube-api-access-6bhm2\") pod \"payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm\" (UID: \"4e1cade8-00f7-4282-9247-39784df16d09\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"
Jul 28 21:02:10.904424 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:10.904264    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b086f8a-7029-4587-a03b-333a11229485-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs\" (UID: \"0b086f8a-7029-4587-a03b-333a11229485\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"
Jul 28 21:02:10.904424 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:10.904315    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e1cade8-00f7-4282-9247-39784df16d09-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm\" (UID: \"4e1cade8-00f7-4282-9247-39784df16d09\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"
Jul 28 21:02:10.904925 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:10.904905    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b086f8a-7029-4587-a03b-333a11229485-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs\" (UID: \"0b086f8a-7029-4587-a03b-333a11229485\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"
Jul 28 21:02:10.914462 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:10.914441    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl676\" (UniqueName: \"kubernetes.io/projected/0b086f8a-7029-4587-a03b-333a11229485-kube-api-access-sl676\") pod \"payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs\" (UID: \"0b086f8a-7029-4587-a03b-333a11229485\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"
Jul 28 21:02:11.004910 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:11.004876    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bhm2\" (UniqueName: \"kubernetes.io/projected/4e1cade8-00f7-4282-9247-39784df16d09-kube-api-access-6bhm2\") pod \"payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm\" (UID: \"4e1cade8-00f7-4282-9247-39784df16d09\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"
Jul 28 21:02:11.005107 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:11.004954    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e1cade8-00f7-4282-9247-39784df16d09-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm\" (UID: \"4e1cade8-00f7-4282-9247-39784df16d09\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"
Jul 28 21:02:11.005687 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:11.005665    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e1cade8-00f7-4282-9247-39784df16d09-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm\" (UID: \"4e1cade8-00f7-4282-9247-39784df16d09\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"
Jul 28 21:02:11.014400 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:11.014374    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bhm2\" (UniqueName: \"kubernetes.io/projected/4e1cade8-00f7-4282-9247-39784df16d09-kube-api-access-6bhm2\") pod \"payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm\" (UID: \"4e1cade8-00f7-4282-9247-39784df16d09\") " pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"
Jul 28 21:02:11.086061 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:11.086031    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"
Jul 28 21:02:11.130765 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:11.130730    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"
Jul 28 21:02:11.236323 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:11.236295    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"]
Jul 28 21:02:11.238463 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:02:11.238435    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b086f8a_7029_4587_a03b_333a11229485.slice/crio-46319b634cac784c43b35cec720bf2148393047a93e3f0c28e27134fff435f74 WatchSource:0}: Error finding container 46319b634cac784c43b35cec720bf2148393047a93e3f0c28e27134fff435f74: Status 404 returned error can't find the container with id 46319b634cac784c43b35cec720bf2148393047a93e3f0c28e27134fff435f74
Jul 28 21:02:11.282540 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:11.282511    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"]
Jul 28 21:02:11.868421 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:11.868386    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs" event={"ID":"0b086f8a-7029-4587-a03b-333a11229485","Type":"ContainerStarted","Data":"fde82dcbcd4b631a6a5609bc7b5f4e24185ce16c10746cf392f8476e4c004954"}
Jul 28 21:02:11.868909 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:11.868444    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs" event={"ID":"0b086f8a-7029-4587-a03b-333a11229485","Type":"ContainerStarted","Data":"46319b634cac784c43b35cec720bf2148393047a93e3f0c28e27134fff435f74"}
Jul 28 21:02:11.868909 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:11.868517    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"
Jul 28 21:02:11.869814 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:11.869794    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm" event={"ID":"4e1cade8-00f7-4282-9247-39784df16d09","Type":"ContainerStarted","Data":"26b411935a36b2c7eecd9c463f6163ecde1ca4040458e074fbaca34f9ff7c277"}
Jul 28 21:02:11.869914 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:11.869829    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm" event={"ID":"4e1cade8-00f7-4282-9247-39784df16d09","Type":"ContainerStarted","Data":"ac998edbb89b5e0ca1fcfcfcc9dc8154dc61cd5f22d19bb337e4203d67b67142"}
Jul 28 21:02:11.869914 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:11.869857    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"
Jul 28 21:02:11.882484 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:11.882440    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs" podStartSLOduration=1.8824262219999999 podStartE2EDuration="1.882426222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:02:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:02:11.881838684 +0000 UTC m=+2246.127215387" watchObservedRunningTime="2026-07-28 21:02:11.882426222 +0000 UTC m=+2246.127802917"
Jul 28 21:02:11.898473 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:11.898427    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm" podStartSLOduration=1.898414426 podStartE2EDuration="1.898414426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:02:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:02:11.897104349 +0000 UTC m=+2246.142481053" watchObservedRunningTime="2026-07-28 21:02:11.898414426 +0000 UTC m=+2246.143791128"
Jul 28 21:02:17.203098 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:17.203064    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:02:22.876827 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:22.876796    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"
Jul 28 21:02:22.877242 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:22.876864    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"
Jul 28 21:02:37.398472 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.398437    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"]
Jul 28 21:02:37.402794 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.402773    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.407810 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.407785    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-7465ef\"/\"kube-root-ca.crt\""
Jul 28 21:02:37.407975 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.407902    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-7465ef\"/\"openshift-service-ca.crt\""
Jul 28 21:02:37.408055 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.408012    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-7465ef\"/\"default-dockercfg-gbjn8\""
Jul 28 21:02:37.408055 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.407835    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-7465ef\"/\"test-model-7465ef-kserve-self-signed-certs\""
Jul 28 21:02:37.411431 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.411311    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"]
Jul 28 21:02:37.554943 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.554897    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-home\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.555123 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.554971    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-dshm\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.555123 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.555032    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-tmp-dir\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.555123 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.555098    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-model-cache\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.555269 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.555127    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftdmz\" (UniqueName: \"kubernetes.io/projected/c51720c3-94f7-4832-9379-6de3884c198a-kube-api-access-ftdmz\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.555269 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.555173    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c51720c3-94f7-4832-9379-6de3884c198a-tls-certs\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.656279 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.656189    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-home\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.656279 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.656238    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-dshm\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.656279 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.656271    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-tmp-dir\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.656540 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.656295    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-model-cache\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.656540 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.656312    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftdmz\" (UniqueName: \"kubernetes.io/projected/c51720c3-94f7-4832-9379-6de3884c198a-kube-api-access-ftdmz\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.656540 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.656348    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c51720c3-94f7-4832-9379-6de3884c198a-tls-certs\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.656697 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.656645    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-home\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.656756 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.656716    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-tmp-dir\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.656756 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.656715    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-model-cache\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.658602 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.658576    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-dshm\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.658729 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.658713    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c51720c3-94f7-4832-9379-6de3884c198a-tls-certs\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.665282 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.665261    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftdmz\" (UniqueName: \"kubernetes.io/projected/c51720c3-94f7-4832-9379-6de3884c198a-kube-api-access-ftdmz\") pod \"test-model-7465ef-kserve-5bf4bcc9d7-kxh9h\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") " pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.714555 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.714528    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:37.849116 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.849012    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"]
Jul 28 21:02:37.851456 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:02:37.851427    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc51720c3_94f7_4832_9379_6de3884c198a.slice/crio-17369c360886a2a309212add566f8fd2dc9ebef7e219c0bdcbb7d4ec321732b6 WatchSource:0}: Error finding container 17369c360886a2a309212add566f8fd2dc9ebef7e219c0bdcbb7d4ec321732b6: Status 404 returned error can't find the container with id 17369c360886a2a309212add566f8fd2dc9ebef7e219c0bdcbb7d4ec321732b6
Jul 28 21:02:37.997617 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.997517    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h" event={"ID":"c51720c3-94f7-4832-9379-6de3884c198a","Type":"ContainerStarted","Data":"5d006754cf84fe6755d5a7a726581dbfb8e942161e4c50875d2d95db83178288"}
Jul 28 21:02:37.997617 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:37.997565    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h" event={"ID":"c51720c3-94f7-4832-9379-6de3884c198a","Type":"ContainerStarted","Data":"17369c360886a2a309212add566f8fd2dc9ebef7e219c0bdcbb7d4ec321732b6"}
Jul 28 21:02:40.599590 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:40.599531    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h" podStartSLOduration=3.599514008 podStartE2EDuration="3.599514008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:02:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:02:38.016995267 +0000 UTC m=+2272.262371970" watchObservedRunningTime="2026-07-28 21:02:40.599514008 +0000 UTC m=+2274.844890710"
Jul 28 21:02:40.600297 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:40.600277    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:02:47.714984 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:47.714948    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:47.715442 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:47.714999    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:47.727755 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:47.727724    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:48.056801 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:48.056717    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:02:51.995354 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:02:51.995317    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:03:03.801725 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:03.801693    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:03:39.513145 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:39.513062    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"]
Jul 28 21:03:44.602194 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:44.602154    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:03:51.141962 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.141909    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"]
Jul 28 21:03:51.142483 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.142200    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487" podUID="ac16ebfb-2f04-4dee-8180-24511716c0cc" containerName="payload-processing" containerID="cri-o://3dee16878b54fb097d74c3476bd1f16666e235a157f924ac71ba6a395db1e24a" gracePeriod=30
Jul 28 21:03:51.150016 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.149988    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"]
Jul 28 21:03:51.150284 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.150257    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl" podUID="55637d4e-4dda-4f53-9fef-05bd82aab83c" containerName="payload-pre-processing" containerID="cri-o://3c1484539d8883cae7a475a77a23c1cc9a0735bb9cbdcbb33738391153961d84" gracePeriod=30
Jul 28 21:03:51.350695 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.350650    2555 generic.go:356] "Generic (PLEG): container finished" podID="ac16ebfb-2f04-4dee-8180-24511716c0cc" containerID="3dee16878b54fb097d74c3476bd1f16666e235a157f924ac71ba6a395db1e24a" exitCode=0
Jul 28 21:03:51.350872 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.350727    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487" event={"ID":"ac16ebfb-2f04-4dee-8180-24511716c0cc","Type":"ContainerDied","Data":"3dee16878b54fb097d74c3476bd1f16666e235a157f924ac71ba6a395db1e24a"}
Jul 28 21:03:51.352515 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.352491    2555 generic.go:356] "Generic (PLEG): container finished" podID="55637d4e-4dda-4f53-9fef-05bd82aab83c" containerID="3c1484539d8883cae7a475a77a23c1cc9a0735bb9cbdcbb33738391153961d84" exitCode=0
Jul 28 21:03:51.352637 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.352558    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl" event={"ID":"55637d4e-4dda-4f53-9fef-05bd82aab83c","Type":"ContainerDied","Data":"3c1484539d8883cae7a475a77a23c1cc9a0735bb9cbdcbb33738391153961d84"}
Jul 28 21:03:51.429339 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.429316    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"
Jul 28 21:03:51.448565 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.448541    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"
Jul 28 21:03:51.552322 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.552282    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sddj8\" (UniqueName: \"kubernetes.io/projected/ac16ebfb-2f04-4dee-8180-24511716c0cc-kube-api-access-sddj8\") pod \"ac16ebfb-2f04-4dee-8180-24511716c0cc\" (UID: \"ac16ebfb-2f04-4dee-8180-24511716c0cc\") "
Jul 28 21:03:51.552506 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.552345    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac16ebfb-2f04-4dee-8180-24511716c0cc-plugins-config-volume\") pod \"ac16ebfb-2f04-4dee-8180-24511716c0cc\" (UID: \"ac16ebfb-2f04-4dee-8180-24511716c0cc\") "
Jul 28 21:03:51.552506 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.552442    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55637d4e-4dda-4f53-9fef-05bd82aab83c-plugins-config-volume\") pod \"55637d4e-4dda-4f53-9fef-05bd82aab83c\" (UID: \"55637d4e-4dda-4f53-9fef-05bd82aab83c\") "
Jul 28 21:03:51.552617 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.552594    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27jcx\" (UniqueName: \"kubernetes.io/projected/55637d4e-4dda-4f53-9fef-05bd82aab83c-kube-api-access-27jcx\") pod \"55637d4e-4dda-4f53-9fef-05bd82aab83c\" (UID: \"55637d4e-4dda-4f53-9fef-05bd82aab83c\") "
Jul 28 21:03:51.552773 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.552744    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac16ebfb-2f04-4dee-8180-24511716c0cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ac16ebfb-2f04-4dee-8180-24511716c0cc" (UID: "ac16ebfb-2f04-4dee-8180-24511716c0cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:03:51.552861 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.552773    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55637d4e-4dda-4f53-9fef-05bd82aab83c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "55637d4e-4dda-4f53-9fef-05bd82aab83c" (UID: "55637d4e-4dda-4f53-9fef-05bd82aab83c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:03:51.552988 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.552972    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac16ebfb-2f04-4dee-8180-24511716c0cc-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:03:51.553044 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.552994    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55637d4e-4dda-4f53-9fef-05bd82aab83c-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:03:51.554427 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.554403    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac16ebfb-2f04-4dee-8180-24511716c0cc-kube-api-access-sddj8" (OuterVolumeSpecName: "kube-api-access-sddj8") pod "ac16ebfb-2f04-4dee-8180-24511716c0cc" (UID: "ac16ebfb-2f04-4dee-8180-24511716c0cc"). InnerVolumeSpecName "kube-api-access-sddj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:03:51.554600 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.554578    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55637d4e-4dda-4f53-9fef-05bd82aab83c-kube-api-access-27jcx" (OuterVolumeSpecName: "kube-api-access-27jcx") pod "55637d4e-4dda-4f53-9fef-05bd82aab83c" (UID: "55637d4e-4dda-4f53-9fef-05bd82aab83c"). InnerVolumeSpecName "kube-api-access-27jcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:03:51.654227 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.654141    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27jcx\" (UniqueName: \"kubernetes.io/projected/55637d4e-4dda-4f53-9fef-05bd82aab83c-kube-api-access-27jcx\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:03:51.654227 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:51.654169    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sddj8\" (UniqueName: \"kubernetes.io/projected/ac16ebfb-2f04-4dee-8180-24511716c0cc-kube-api-access-sddj8\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:03:52.358722 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:52.358686    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"
Jul 28 21:03:52.359232 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:52.358693    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487" event={"ID":"ac16ebfb-2f04-4dee-8180-24511716c0cc","Type":"ContainerDied","Data":"c89ddee8f3e46131cdc7866919f3c20936bb3bc2808819c2e1ab0e7854ab6898"}
Jul 28 21:03:52.359232 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:52.358808    2555 scope.go:117] "RemoveContainer" containerID="3dee16878b54fb097d74c3476bd1f16666e235a157f924ac71ba6a395db1e24a"
Jul 28 21:03:52.360363 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:52.360259    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"
Jul 28 21:03:52.360363 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:52.360325    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl" event={"ID":"55637d4e-4dda-4f53-9fef-05bd82aab83c","Type":"ContainerDied","Data":"a167cf34a4e2ca41ba5bbf10454eb781382318559e5f2c8d6226671225cb89d8"}
Jul 28 21:03:52.367980 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:52.367963    2555 scope.go:117] "RemoveContainer" containerID="3c1484539d8883cae7a475a77a23c1cc9a0735bb9cbdcbb33738391153961d84"
Jul 28 21:03:52.378498 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:52.378476    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"]
Jul 28 21:03:52.380240 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:52.380220    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-7465ef-d5c4b7fdd-pszhl"]
Jul 28 21:03:52.388994 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:52.388971    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"]
Jul 28 21:03:52.397591 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:52.397568    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-7465ef-86f7ff6fdd-l6487"]
Jul 28 21:03:54.295809 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.295770    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55637d4e-4dda-4f53-9fef-05bd82aab83c" path="/var/lib/kubelet/pods/55637d4e-4dda-4f53-9fef-05bd82aab83c/volumes"
Jul 28 21:03:54.296230 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.296194    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac16ebfb-2f04-4dee-8180-24511716c0cc" path="/var/lib/kubelet/pods/ac16ebfb-2f04-4dee-8180-24511716c0cc/volumes"
Jul 28 21:03:54.532620 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.532578    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h" podUID="c51720c3-94f7-4832-9379-6de3884c198a" containerName="main" containerID="cri-o://5d006754cf84fe6755d5a7a726581dbfb8e942161e4c50875d2d95db83178288" gracePeriod=45
Jul 28 21:03:54.789842 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.789808    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:03:54.885471 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.885437    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c51720c3-94f7-4832-9379-6de3884c198a-tls-certs\") pod \"c51720c3-94f7-4832-9379-6de3884c198a\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") "
Jul 28 21:03:54.885471 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.885485    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-home\") pod \"c51720c3-94f7-4832-9379-6de3884c198a\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") "
Jul 28 21:03:54.885737 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.885509    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-model-cache\") pod \"c51720c3-94f7-4832-9379-6de3884c198a\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") "
Jul 28 21:03:54.885737 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.885539    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftdmz\" (UniqueName: \"kubernetes.io/projected/c51720c3-94f7-4832-9379-6de3884c198a-kube-api-access-ftdmz\") pod \"c51720c3-94f7-4832-9379-6de3884c198a\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") "
Jul 28 21:03:54.885737 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.885686    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-dshm\") pod \"c51720c3-94f7-4832-9379-6de3884c198a\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") "
Jul 28 21:03:54.885920 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.885752    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-tmp-dir\") pod \"c51720c3-94f7-4832-9379-6de3884c198a\" (UID: \"c51720c3-94f7-4832-9379-6de3884c198a\") "
Jul 28 21:03:54.885920 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.885803    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-home" (OuterVolumeSpecName: "home") pod "c51720c3-94f7-4832-9379-6de3884c198a" (UID: "c51720c3-94f7-4832-9379-6de3884c198a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:03:54.885920 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.885817    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-model-cache" (OuterVolumeSpecName: "model-cache") pod "c51720c3-94f7-4832-9379-6de3884c198a" (UID: "c51720c3-94f7-4832-9379-6de3884c198a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:03:54.886100 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.885973    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c51720c3-94f7-4832-9379-6de3884c198a" (UID: "c51720c3-94f7-4832-9379-6de3884c198a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:03:54.886159 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.886141    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-home\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:03:54.886195 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.886165    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-model-cache\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:03:54.886245 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.886206    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-tmp-dir\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:03:54.887866 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.887835    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-dshm" (OuterVolumeSpecName: "dshm") pod "c51720c3-94f7-4832-9379-6de3884c198a" (UID: "c51720c3-94f7-4832-9379-6de3884c198a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:03:54.888019 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.887895    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c51720c3-94f7-4832-9379-6de3884c198a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c51720c3-94f7-4832-9379-6de3884c198a" (UID: "c51720c3-94f7-4832-9379-6de3884c198a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:03:54.888019 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.887912    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c51720c3-94f7-4832-9379-6de3884c198a-kube-api-access-ftdmz" (OuterVolumeSpecName: "kube-api-access-ftdmz") pod "c51720c3-94f7-4832-9379-6de3884c198a" (UID: "c51720c3-94f7-4832-9379-6de3884c198a"). InnerVolumeSpecName "kube-api-access-ftdmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:03:54.987687 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.987648    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c51720c3-94f7-4832-9379-6de3884c198a-tls-certs\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:03:54.987687 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.987682    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftdmz\" (UniqueName: \"kubernetes.io/projected/c51720c3-94f7-4832-9379-6de3884c198a-kube-api-access-ftdmz\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:03:54.987687 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:54.987694    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c51720c3-94f7-4832-9379-6de3884c198a-dshm\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:03:55.377010 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:55.376973    2555 generic.go:356] "Generic (PLEG): container finished" podID="c51720c3-94f7-4832-9379-6de3884c198a" containerID="5d006754cf84fe6755d5a7a726581dbfb8e942161e4c50875d2d95db83178288" exitCode=0
Jul 28 21:03:55.377535 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:55.377019    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"
Jul 28 21:03:55.377535 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:55.377054    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h" event={"ID":"c51720c3-94f7-4832-9379-6de3884c198a","Type":"ContainerDied","Data":"5d006754cf84fe6755d5a7a726581dbfb8e942161e4c50875d2d95db83178288"}
Jul 28 21:03:55.377535 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:55.377096    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h" event={"ID":"c51720c3-94f7-4832-9379-6de3884c198a","Type":"ContainerDied","Data":"17369c360886a2a309212add566f8fd2dc9ebef7e219c0bdcbb7d4ec321732b6"}
Jul 28 21:03:55.377535 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:55.377113    2555 scope.go:117] "RemoveContainer" containerID="5d006754cf84fe6755d5a7a726581dbfb8e942161e4c50875d2d95db83178288"
Jul 28 21:03:55.389216 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:55.389199    2555 scope.go:117] "RemoveContainer" containerID="5d006754cf84fe6755d5a7a726581dbfb8e942161e4c50875d2d95db83178288"
Jul 28 21:03:55.389464 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:03:55.389446    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d006754cf84fe6755d5a7a726581dbfb8e942161e4c50875d2d95db83178288\": container with ID starting with 5d006754cf84fe6755d5a7a726581dbfb8e942161e4c50875d2d95db83178288 not found: ID does not exist" containerID="5d006754cf84fe6755d5a7a726581dbfb8e942161e4c50875d2d95db83178288"
Jul 28 21:03:55.389531 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:55.389477    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d006754cf84fe6755d5a7a726581dbfb8e942161e4c50875d2d95db83178288"} err="failed to get container status \"5d006754cf84fe6755d5a7a726581dbfb8e942161e4c50875d2d95db83178288\": rpc error: code = NotFound desc = could not find container \"5d006754cf84fe6755d5a7a726581dbfb8e942161e4c50875d2d95db83178288\": container with ID starting with 5d006754cf84fe6755d5a7a726581dbfb8e942161e4c50875d2d95db83178288 not found: ID does not exist"
Jul 28 21:03:55.400261 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:55.400236    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"]
Jul 28 21:03:55.406909 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:55.406886    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-7465ef/test-model-7465ef-kserve-5bf4bcc9d7-kxh9h"]
Jul 28 21:03:56.297001 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:56.296969    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c51720c3-94f7-4832-9379-6de3884c198a" path="/var/lib/kubelet/pods/c51720c3-94f7-4832-9379-6de3884c198a/volumes"
Jul 28 21:03:56.896363 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:03:56.896330    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:04:08.947785 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:08.947747    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"]
Jul 28 21:04:08.948244 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:08.948046    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm" podUID="4e1cade8-00f7-4282-9247-39784df16d09" containerName="payload-processing" containerID="cri-o://26b411935a36b2c7eecd9c463f6163ecde1ca4040458e074fbaca34f9ff7c277" gracePeriod=30
Jul 28 21:04:08.954461 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:08.954435    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"]
Jul 28 21:04:08.954886 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:08.954837    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs" podUID="0b086f8a-7029-4587-a03b-333a11229485" containerName="payload-pre-processing" containerID="cri-o://fde82dcbcd4b631a6a5609bc7b5f4e24185ce16c10746cf392f8476e4c004954" gracePeriod=30
Jul 28 21:04:09.215313 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.215290    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"
Jul 28 21:04:09.243743 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.243709    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"
Jul 28 21:04:09.316889 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.316857    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b086f8a-7029-4587-a03b-333a11229485-plugins-config-volume\") pod \"0b086f8a-7029-4587-a03b-333a11229485\" (UID: \"0b086f8a-7029-4587-a03b-333a11229485\") "
Jul 28 21:04:09.316889 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.316895    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e1cade8-00f7-4282-9247-39784df16d09-plugins-config-volume\") pod \"4e1cade8-00f7-4282-9247-39784df16d09\" (UID: \"4e1cade8-00f7-4282-9247-39784df16d09\") "
Jul 28 21:04:09.317169 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.316947    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sl676\" (UniqueName: \"kubernetes.io/projected/0b086f8a-7029-4587-a03b-333a11229485-kube-api-access-sl676\") pod \"0b086f8a-7029-4587-a03b-333a11229485\" (UID: \"0b086f8a-7029-4587-a03b-333a11229485\") "
Jul 28 21:04:09.317169 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.316964    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bhm2\" (UniqueName: \"kubernetes.io/projected/4e1cade8-00f7-4282-9247-39784df16d09-kube-api-access-6bhm2\") pod \"4e1cade8-00f7-4282-9247-39784df16d09\" (UID: \"4e1cade8-00f7-4282-9247-39784df16d09\") "
Jul 28 21:04:09.317351 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.317323    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b086f8a-7029-4587-a03b-333a11229485-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0b086f8a-7029-4587-a03b-333a11229485" (UID: "0b086f8a-7029-4587-a03b-333a11229485"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:04:09.317409 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.317328    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e1cade8-00f7-4282-9247-39784df16d09-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4e1cade8-00f7-4282-9247-39784df16d09" (UID: "4e1cade8-00f7-4282-9247-39784df16d09"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:04:09.319133 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.319107    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e1cade8-00f7-4282-9247-39784df16d09-kube-api-access-6bhm2" (OuterVolumeSpecName: "kube-api-access-6bhm2") pod "4e1cade8-00f7-4282-9247-39784df16d09" (UID: "4e1cade8-00f7-4282-9247-39784df16d09"). InnerVolumeSpecName "kube-api-access-6bhm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:04:09.319133 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.319122    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b086f8a-7029-4587-a03b-333a11229485-kube-api-access-sl676" (OuterVolumeSpecName: "kube-api-access-sl676") pod "0b086f8a-7029-4587-a03b-333a11229485" (UID: "0b086f8a-7029-4587-a03b-333a11229485"). InnerVolumeSpecName "kube-api-access-sl676". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:04:09.418520 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.418477    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sl676\" (UniqueName: \"kubernetes.io/projected/0b086f8a-7029-4587-a03b-333a11229485-kube-api-access-sl676\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:04:09.418520 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.418511    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bhm2\" (UniqueName: \"kubernetes.io/projected/4e1cade8-00f7-4282-9247-39784df16d09-kube-api-access-6bhm2\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:04:09.418520 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.418527    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b086f8a-7029-4587-a03b-333a11229485-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:04:09.418753 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.418541    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e1cade8-00f7-4282-9247-39784df16d09-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:04:09.448145 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.448109    2555 generic.go:356] "Generic (PLEG): container finished" podID="0b086f8a-7029-4587-a03b-333a11229485" containerID="fde82dcbcd4b631a6a5609bc7b5f4e24185ce16c10746cf392f8476e4c004954" exitCode=0
Jul 28 21:04:09.448298 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.448157    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"
Jul 28 21:04:09.448298 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.448201    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs" event={"ID":"0b086f8a-7029-4587-a03b-333a11229485","Type":"ContainerDied","Data":"fde82dcbcd4b631a6a5609bc7b5f4e24185ce16c10746cf392f8476e4c004954"}
Jul 28 21:04:09.448298 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.448267    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs" event={"ID":"0b086f8a-7029-4587-a03b-333a11229485","Type":"ContainerDied","Data":"46319b634cac784c43b35cec720bf2148393047a93e3f0c28e27134fff435f74"}
Jul 28 21:04:09.448420 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.448299    2555 scope.go:117] "RemoveContainer" containerID="fde82dcbcd4b631a6a5609bc7b5f4e24185ce16c10746cf392f8476e4c004954"
Jul 28 21:04:09.449675 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.449654    2555 generic.go:356] "Generic (PLEG): container finished" podID="4e1cade8-00f7-4282-9247-39784df16d09" containerID="26b411935a36b2c7eecd9c463f6163ecde1ca4040458e074fbaca34f9ff7c277" exitCode=0
Jul 28 21:04:09.449757 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.449701    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"
Jul 28 21:04:09.449800 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.449745    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm" event={"ID":"4e1cade8-00f7-4282-9247-39784df16d09","Type":"ContainerDied","Data":"26b411935a36b2c7eecd9c463f6163ecde1ca4040458e074fbaca34f9ff7c277"}
Jul 28 21:04:09.449843 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.449811    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm" event={"ID":"4e1cade8-00f7-4282-9247-39784df16d09","Type":"ContainerDied","Data":"ac998edbb89b5e0ca1fcfcfcc9dc8154dc61cd5f22d19bb337e4203d67b67142"}
Jul 28 21:04:09.458408 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.458295    2555 scope.go:117] "RemoveContainer" containerID="fde82dcbcd4b631a6a5609bc7b5f4e24185ce16c10746cf392f8476e4c004954"
Jul 28 21:04:09.458671 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:04:09.458648    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fde82dcbcd4b631a6a5609bc7b5f4e24185ce16c10746cf392f8476e4c004954\": container with ID starting with fde82dcbcd4b631a6a5609bc7b5f4e24185ce16c10746cf392f8476e4c004954 not found: ID does not exist" containerID="fde82dcbcd4b631a6a5609bc7b5f4e24185ce16c10746cf392f8476e4c004954"
Jul 28 21:04:09.458760 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.458680    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fde82dcbcd4b631a6a5609bc7b5f4e24185ce16c10746cf392f8476e4c004954"} err="failed to get container status \"fde82dcbcd4b631a6a5609bc7b5f4e24185ce16c10746cf392f8476e4c004954\": rpc error: code = NotFound desc = could not find container \"fde82dcbcd4b631a6a5609bc7b5f4e24185ce16c10746cf392f8476e4c004954\": container with ID starting with fde82dcbcd4b631a6a5609bc7b5f4e24185ce16c10746cf392f8476e4c004954 not found: ID does not exist"
Jul 28 21:04:09.458760 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.458711    2555 scope.go:117] "RemoveContainer" containerID="26b411935a36b2c7eecd9c463f6163ecde1ca4040458e074fbaca34f9ff7c277"
Jul 28 21:04:09.467003 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.466986    2555 scope.go:117] "RemoveContainer" containerID="26b411935a36b2c7eecd9c463f6163ecde1ca4040458e074fbaca34f9ff7c277"
Jul 28 21:04:09.467313 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:04:09.467293    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26b411935a36b2c7eecd9c463f6163ecde1ca4040458e074fbaca34f9ff7c277\": container with ID starting with 26b411935a36b2c7eecd9c463f6163ecde1ca4040458e074fbaca34f9ff7c277 not found: ID does not exist" containerID="26b411935a36b2c7eecd9c463f6163ecde1ca4040458e074fbaca34f9ff7c277"
Jul 28 21:04:09.467409 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.467318    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26b411935a36b2c7eecd9c463f6163ecde1ca4040458e074fbaca34f9ff7c277"} err="failed to get container status \"26b411935a36b2c7eecd9c463f6163ecde1ca4040458e074fbaca34f9ff7c277\": rpc error: code = NotFound desc = could not find container \"26b411935a36b2c7eecd9c463f6163ecde1ca4040458e074fbaca34f9ff7c277\": container with ID starting with 26b411935a36b2c7eecd9c463f6163ecde1ca4040458e074fbaca34f9ff7c277 not found: ID does not exist"
Jul 28 21:04:09.488838 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.488753    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"]
Jul 28 21:04:09.490703 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.490679    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-3d8bda-679d7477dd-7jdhs"]
Jul 28 21:04:09.524896 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.524864    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"]
Jul 28 21:04:09.541086 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:09.541056    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-3d8bda-7949c96d6d-qmjbm"]
Jul 28 21:04:10.296067 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:10.295992    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b086f8a-7029-4587-a03b-333a11229485" path="/var/lib/kubelet/pods/0b086f8a-7029-4587-a03b-333a11229485/volumes"
Jul 28 21:04:10.296424 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:10.296367    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e1cade8-00f7-4282-9247-39784df16d09" path="/var/lib/kubelet/pods/4e1cade8-00f7-4282-9247-39784df16d09/volumes"
Jul 28 21:04:11.800803 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:11.800761    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:04:20.365671 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.365629    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"]
Jul 28 21:04:20.366191 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.366168    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55637d4e-4dda-4f53-9fef-05bd82aab83c" containerName="payload-pre-processing"
Jul 28 21:04:20.366261 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.366195    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="55637d4e-4dda-4f53-9fef-05bd82aab83c" containerName="payload-pre-processing"
Jul 28 21:04:20.366261 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.366213    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac16ebfb-2f04-4dee-8180-24511716c0cc" containerName="payload-processing"
Jul 28 21:04:20.366261 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.366222    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac16ebfb-2f04-4dee-8180-24511716c0cc" containerName="payload-processing"
Jul 28 21:04:20.366261 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.366249    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b086f8a-7029-4587-a03b-333a11229485" containerName="payload-pre-processing"
Jul 28 21:04:20.366261 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.366257    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b086f8a-7029-4587-a03b-333a11229485" containerName="payload-pre-processing"
Jul 28 21:04:20.366515 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.366273    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e1cade8-00f7-4282-9247-39784df16d09" containerName="payload-processing"
Jul 28 21:04:20.366515 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.366282    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e1cade8-00f7-4282-9247-39784df16d09" containerName="payload-processing"
Jul 28 21:04:20.366515 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.366305    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c51720c3-94f7-4832-9379-6de3884c198a" containerName="main"
Jul 28 21:04:20.366515 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.366313    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c51720c3-94f7-4832-9379-6de3884c198a" containerName="main"
Jul 28 21:04:20.366515 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.366397    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e1cade8-00f7-4282-9247-39784df16d09" containerName="payload-processing"
Jul 28 21:04:20.366515 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.366411    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c51720c3-94f7-4832-9379-6de3884c198a" containerName="main"
Jul 28 21:04:20.366515 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.366420    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b086f8a-7029-4587-a03b-333a11229485" containerName="payload-pre-processing"
Jul 28 21:04:20.366515 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.366431    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac16ebfb-2f04-4dee-8180-24511716c0cc" containerName="payload-processing"
Jul 28 21:04:20.366515 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.366440    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="55637d4e-4dda-4f53-9fef-05bd82aab83c" containerName="payload-pre-processing"
Jul 28 21:04:20.370953 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.370905    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"
Jul 28 21:04:20.373659 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.373636    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-8e6a5a-dockercfg-9slvr\""
Jul 28 21:04:20.373775 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.373636    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-8e6a5a\""
Jul 28 21:04:20.379543 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.379511    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"]
Jul 28 21:04:20.492425 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.492391    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"]
Jul 28 21:04:20.495894 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.495876    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"
Jul 28 21:04:20.505078 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.505053    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"]
Jul 28 21:04:20.516022 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.515983    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40bedbf6-bd75-47cb-aedf-5615cddab561-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9\" (UID: \"40bedbf6-bd75-47cb-aedf-5615cddab561\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"
Jul 28 21:04:20.516191 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.516051    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwqqd\" (UniqueName: \"kubernetes.io/projected/40bedbf6-bd75-47cb-aedf-5615cddab561-kube-api-access-gwqqd\") pod \"payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9\" (UID: \"40bedbf6-bd75-47cb-aedf-5615cddab561\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"
Jul 28 21:04:20.617071 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.616966    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zp2m\" (UniqueName: \"kubernetes.io/projected/94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8-kube-api-access-6zp2m\") pod \"payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf\" (UID: \"94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8\") " pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"
Jul 28 21:04:20.617071 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.617046    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40bedbf6-bd75-47cb-aedf-5615cddab561-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9\" (UID: \"40bedbf6-bd75-47cb-aedf-5615cddab561\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"
Jul 28 21:04:20.617071 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.617070    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwqqd\" (UniqueName: \"kubernetes.io/projected/40bedbf6-bd75-47cb-aedf-5615cddab561-kube-api-access-gwqqd\") pod \"payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9\" (UID: \"40bedbf6-bd75-47cb-aedf-5615cddab561\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"
Jul 28 21:04:20.617368 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.617155    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf\" (UID: \"94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8\") " pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"
Jul 28 21:04:20.617786 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.617761    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40bedbf6-bd75-47cb-aedf-5615cddab561-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9\" (UID: \"40bedbf6-bd75-47cb-aedf-5615cddab561\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"
Jul 28 21:04:20.625264 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.625235    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwqqd\" (UniqueName: \"kubernetes.io/projected/40bedbf6-bd75-47cb-aedf-5615cddab561-kube-api-access-gwqqd\") pod \"payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9\" (UID: \"40bedbf6-bd75-47cb-aedf-5615cddab561\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"
Jul 28 21:04:20.684189 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.684135    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"
Jul 28 21:04:20.718666 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.718632    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf\" (UID: \"94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8\") " pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"
Jul 28 21:04:20.718855 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.718673    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zp2m\" (UniqueName: \"kubernetes.io/projected/94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8-kube-api-access-6zp2m\") pod \"payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf\" (UID: \"94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8\") " pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"
Jul 28 21:04:20.719462 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.719432    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf\" (UID: \"94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8\") " pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"
Jul 28 21:04:20.727433 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.727409    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zp2m\" (UniqueName: \"kubernetes.io/projected/94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8-kube-api-access-6zp2m\") pod \"payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf\" (UID: \"94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8\") " pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"
Jul 28 21:04:20.806421 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.806388    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"
Jul 28 21:04:20.828560 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.828531    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"]
Jul 28 21:04:20.831252 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:04:20.831227    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40bedbf6_bd75_47cb_aedf_5615cddab561.slice/crio-09850dee8ae51279c3f32a13f55c155b9695ca368f75fa132a5082b5c8097b9c WatchSource:0}: Error finding container 09850dee8ae51279c3f32a13f55c155b9695ca368f75fa132a5082b5c8097b9c: Status 404 returned error can't find the container with id 09850dee8ae51279c3f32a13f55c155b9695ca368f75fa132a5082b5c8097b9c
Jul 28 21:04:20.953255 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:20.953230    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"]
Jul 28 21:04:20.955714 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:04:20.955686    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a7b8ca_4d2d_4281_bd26_0ad8fda7e5a8.slice/crio-cf342fe91543528125207de4eab7fe01f52289d36a29acc6536dec9f1f3043fb WatchSource:0}: Error finding container cf342fe91543528125207de4eab7fe01f52289d36a29acc6536dec9f1f3043fb: Status 404 returned error can't find the container with id cf342fe91543528125207de4eab7fe01f52289d36a29acc6536dec9f1f3043fb
Jul 28 21:04:21.516253 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:21.516200    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf" event={"ID":"94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8","Type":"ContainerStarted","Data":"027929bf1750c980f960f2ae57dd423efebf6ba4c4ac8f33d90eeb0b4d0d0110"}
Jul 28 21:04:21.516742 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:21.516268    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf" event={"ID":"94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8","Type":"ContainerStarted","Data":"cf342fe91543528125207de4eab7fe01f52289d36a29acc6536dec9f1f3043fb"}
Jul 28 21:04:21.516742 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:21.516401    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"
Jul 28 21:04:21.517795 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:21.517769    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9" event={"ID":"40bedbf6-bd75-47cb-aedf-5615cddab561","Type":"ContainerStarted","Data":"192ebbdad4b427d29f9967c49c12c79336ed3dbe9d618a9bf70aa5817397d92d"}
Jul 28 21:04:21.517959 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:21.517814    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9" event={"ID":"40bedbf6-bd75-47cb-aedf-5615cddab561","Type":"ContainerStarted","Data":"09850dee8ae51279c3f32a13f55c155b9695ca368f75fa132a5082b5c8097b9c"}
Jul 28 21:04:21.517959 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:21.517851    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"
Jul 28 21:04:21.532548 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:21.532494    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf" podStartSLOduration=1.532478374 podStartE2EDuration="1.532478374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:04:21.531604749 +0000 UTC m=+2375.776981450" watchObservedRunningTime="2026-07-28 21:04:21.532478374 +0000 UTC m=+2375.777855075"
Jul 28 21:04:21.548212 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:21.548160    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9" podStartSLOduration=1.5481421530000001 podStartE2EDuration="1.548142153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:04:21.546458962 +0000 UTC m=+2375.791835678" watchObservedRunningTime="2026-07-28 21:04:21.548142153 +0000 UTC m=+2375.793518855"
Jul 28 21:04:25.201780 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:25.201742    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:04:32.525012 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:32.524979    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"
Jul 28 21:04:32.525582 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:32.525053    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"
Jul 28 21:04:46.414526 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:46.414411    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 21:04:46.424342 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:46.424321    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 21:04:49.539698 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.539659    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"]
Jul 28 21:04:49.544451 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.544431    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"
Jul 28 21:04:49.547020 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.546989    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-fec7c6\""
Jul 28 21:04:49.547167 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.547046    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-fec7c6-dockercfg-x6dtc\""
Jul 28 21:04:49.551287 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.551264    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"]
Jul 28 21:04:49.578999 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.578963    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"]
Jul 28 21:04:49.582428 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.582411    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"
Jul 28 21:04:49.592231 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.592202    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"]
Jul 28 21:04:49.680488 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.680448    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z49kv\" (UniqueName: \"kubernetes.io/projected/8b0be7c6-74b0-42e3-ac79-8280767d1026-kube-api-access-z49kv\") pod \"payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2\" (UID: \"8b0be7c6-74b0-42e3-ac79-8280767d1026\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"
Jul 28 21:04:49.680670 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.680548    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlmkb\" (UniqueName: \"kubernetes.io/projected/9101d45d-6fb7-40f9-9ec8-7c80ed87f80a-kube-api-access-qlmkb\") pod \"payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl\" (UID: \"9101d45d-6fb7-40f9-9ec8-7c80ed87f80a\") " pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"
Jul 28 21:04:49.680670 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.680627    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b0be7c6-74b0-42e3-ac79-8280767d1026-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2\" (UID: \"8b0be7c6-74b0-42e3-ac79-8280767d1026\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"
Jul 28 21:04:49.680743 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.680681    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9101d45d-6fb7-40f9-9ec8-7c80ed87f80a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl\" (UID: \"9101d45d-6fb7-40f9-9ec8-7c80ed87f80a\") " pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"
Jul 28 21:04:49.782115 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.782063    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9101d45d-6fb7-40f9-9ec8-7c80ed87f80a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl\" (UID: \"9101d45d-6fb7-40f9-9ec8-7c80ed87f80a\") " pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"
Jul 28 21:04:49.782298 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.782156    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z49kv\" (UniqueName: \"kubernetes.io/projected/8b0be7c6-74b0-42e3-ac79-8280767d1026-kube-api-access-z49kv\") pod \"payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2\" (UID: \"8b0be7c6-74b0-42e3-ac79-8280767d1026\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"
Jul 28 21:04:49.782298 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.782198    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlmkb\" (UniqueName: \"kubernetes.io/projected/9101d45d-6fb7-40f9-9ec8-7c80ed87f80a-kube-api-access-qlmkb\") pod \"payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl\" (UID: \"9101d45d-6fb7-40f9-9ec8-7c80ed87f80a\") " pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"
Jul 28 21:04:49.782298 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.782240    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b0be7c6-74b0-42e3-ac79-8280767d1026-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2\" (UID: \"8b0be7c6-74b0-42e3-ac79-8280767d1026\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"
Jul 28 21:04:49.782857 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.782836    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9101d45d-6fb7-40f9-9ec8-7c80ed87f80a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl\" (UID: \"9101d45d-6fb7-40f9-9ec8-7c80ed87f80a\") " pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"
Jul 28 21:04:49.782900 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.782873    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b0be7c6-74b0-42e3-ac79-8280767d1026-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2\" (UID: \"8b0be7c6-74b0-42e3-ac79-8280767d1026\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"
Jul 28 21:04:49.790002 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.789908    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z49kv\" (UniqueName: \"kubernetes.io/projected/8b0be7c6-74b0-42e3-ac79-8280767d1026-kube-api-access-z49kv\") pod \"payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2\" (UID: \"8b0be7c6-74b0-42e3-ac79-8280767d1026\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"
Jul 28 21:04:49.790544 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.790527    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlmkb\" (UniqueName: \"kubernetes.io/projected/9101d45d-6fb7-40f9-9ec8-7c80ed87f80a-kube-api-access-qlmkb\") pod \"payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl\" (UID: \"9101d45d-6fb7-40f9-9ec8-7c80ed87f80a\") " pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"
Jul 28 21:04:49.855776 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.855729    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"
Jul 28 21:04:49.893222 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:49.893184    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"
Jul 28 21:04:50.024031 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:50.023979    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"]
Jul 28 21:04:50.025346 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:04:50.025316    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b0be7c6_74b0_42e3_ac79_8280767d1026.slice/crio-d763ec3080cf12c77c65ab891349320e3395875cbd0e54c16158ff5a7411082f WatchSource:0}: Error finding container d763ec3080cf12c77c65ab891349320e3395875cbd0e54c16158ff5a7411082f: Status 404 returned error can't find the container with id d763ec3080cf12c77c65ab891349320e3395875cbd0e54c16158ff5a7411082f
Jul 28 21:04:50.069294 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:50.069248    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"]
Jul 28 21:04:50.071822 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:04:50.071797    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9101d45d_6fb7_40f9_9ec8_7c80ed87f80a.slice/crio-05298031d9a8c3d83ea67c5e85fa0b8b4d5962c578aad4c435f36e49be100122 WatchSource:0}: Error finding container 05298031d9a8c3d83ea67c5e85fa0b8b4d5962c578aad4c435f36e49be100122: Status 404 returned error can't find the container with id 05298031d9a8c3d83ea67c5e85fa0b8b4d5962c578aad4c435f36e49be100122
Jul 28 21:04:50.673952 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:50.673905    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2" event={"ID":"8b0be7c6-74b0-42e3-ac79-8280767d1026","Type":"ContainerStarted","Data":"022cef702dd353b1b66be7f0d64bc7a5b6ffada99a5fc28c30af3705825300f2"}
Jul 28 21:04:50.674439 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:50.673985    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2" event={"ID":"8b0be7c6-74b0-42e3-ac79-8280767d1026","Type":"ContainerStarted","Data":"d763ec3080cf12c77c65ab891349320e3395875cbd0e54c16158ff5a7411082f"}
Jul 28 21:04:50.674439 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:50.674015    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"
Jul 28 21:04:50.675636 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:50.675614    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl" event={"ID":"9101d45d-6fb7-40f9-9ec8-7c80ed87f80a","Type":"ContainerStarted","Data":"f8166f05aaecd82f54daa9cc1a33725ba0743473bc8bb9fa67f66ec92e0bb63e"}
Jul 28 21:04:50.675759 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:50.675653    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl" event={"ID":"9101d45d-6fb7-40f9-9ec8-7c80ed87f80a","Type":"ContainerStarted","Data":"05298031d9a8c3d83ea67c5e85fa0b8b4d5962c578aad4c435f36e49be100122"}
Jul 28 21:04:50.675759 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:50.675738    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"
Jul 28 21:04:50.689532 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:50.689485    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2" podStartSLOduration=1.6894691530000001 podStartE2EDuration="1.689469153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:04:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:04:50.688594794 +0000 UTC m=+2404.933971496" watchObservedRunningTime="2026-07-28 21:04:50.689469153 +0000 UTC m=+2404.934845854"
Jul 28 21:04:50.704472 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:50.704427    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl" podStartSLOduration=1.7044115020000001 podStartE2EDuration="1.704411502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:04:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:04:50.702016196 +0000 UTC m=+2404.947392910" watchObservedRunningTime="2026-07-28 21:04:50.704411502 +0000 UTC m=+2404.949788204"
Jul 28 21:04:55.601198 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:04:55.601165    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:05:01.682380 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:01.682351    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"
Jul 28 21:05:01.682772 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:01.682417    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"
Jul 28 21:05:32.244267 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.244229    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"]
Jul 28 21:05:32.244807 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.244490    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf" podUID="94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8" containerName="payload-processing" containerID="cri-o://027929bf1750c980f960f2ae57dd423efebf6ba4c4ac8f33d90eeb0b4d0d0110" gracePeriod=30
Jul 28 21:05:32.252052 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.251604    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"]
Jul 28 21:05:32.252052 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.251838    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9" podUID="40bedbf6-bd75-47cb-aedf-5615cddab561" containerName="payload-pre-processing" containerID="cri-o://192ebbdad4b427d29f9967c49c12c79336ed3dbe9d618a9bf70aa5817397d92d" gracePeriod=30
Jul 28 21:05:32.501267 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.501201    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"
Jul 28 21:05:32.533071 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.533039    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"
Jul 28 21:05:32.574895 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.574856    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8-plugins-config-volume\") pod \"94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8\" (UID: \"94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8\") "
Jul 28 21:05:32.575114 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.574958    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zp2m\" (UniqueName: \"kubernetes.io/projected/94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8-kube-api-access-6zp2m\") pod \"94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8\" (UID: \"94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8\") "
Jul 28 21:05:32.575274 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.575253    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8" (UID: "94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:05:32.576986 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.576965    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8-kube-api-access-6zp2m" (OuterVolumeSpecName: "kube-api-access-6zp2m") pod "94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8" (UID: "94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8"). InnerVolumeSpecName "kube-api-access-6zp2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:05:32.676266 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.676231    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40bedbf6-bd75-47cb-aedf-5615cddab561-plugins-config-volume\") pod \"40bedbf6-bd75-47cb-aedf-5615cddab561\" (UID: \"40bedbf6-bd75-47cb-aedf-5615cddab561\") "
Jul 28 21:05:32.676443 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.676291    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwqqd\" (UniqueName: \"kubernetes.io/projected/40bedbf6-bd75-47cb-aedf-5615cddab561-kube-api-access-gwqqd\") pod \"40bedbf6-bd75-47cb-aedf-5615cddab561\" (UID: \"40bedbf6-bd75-47cb-aedf-5615cddab561\") "
Jul 28 21:05:32.676530 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.676473    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:05:32.676530 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.676484    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zp2m\" (UniqueName: \"kubernetes.io/projected/94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8-kube-api-access-6zp2m\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:05:32.676732 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.676706    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40bedbf6-bd75-47cb-aedf-5615cddab561-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "40bedbf6-bd75-47cb-aedf-5615cddab561" (UID: "40bedbf6-bd75-47cb-aedf-5615cddab561"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:05:32.678370 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.678350    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40bedbf6-bd75-47cb-aedf-5615cddab561-kube-api-access-gwqqd" (OuterVolumeSpecName: "kube-api-access-gwqqd") pod "40bedbf6-bd75-47cb-aedf-5615cddab561" (UID: "40bedbf6-bd75-47cb-aedf-5615cddab561"). InnerVolumeSpecName "kube-api-access-gwqqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:05:32.777293 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.777200    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40bedbf6-bd75-47cb-aedf-5615cddab561-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:05:32.777293 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.777232    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwqqd\" (UniqueName: \"kubernetes.io/projected/40bedbf6-bd75-47cb-aedf-5615cddab561-kube-api-access-gwqqd\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:05:32.874871 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.874840    2555 generic.go:356] "Generic (PLEG): container finished" podID="94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8" containerID="027929bf1750c980f960f2ae57dd423efebf6ba4c4ac8f33d90eeb0b4d0d0110" exitCode=0
Jul 28 21:05:32.875039 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.874882    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"
Jul 28 21:05:32.875039 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.874920    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf" event={"ID":"94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8","Type":"ContainerDied","Data":"027929bf1750c980f960f2ae57dd423efebf6ba4c4ac8f33d90eeb0b4d0d0110"}
Jul 28 21:05:32.875039 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.874999    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf" event={"ID":"94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8","Type":"ContainerDied","Data":"cf342fe91543528125207de4eab7fe01f52289d36a29acc6536dec9f1f3043fb"}
Jul 28 21:05:32.875039 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.875029    2555 scope.go:117] "RemoveContainer" containerID="027929bf1750c980f960f2ae57dd423efebf6ba4c4ac8f33d90eeb0b4d0d0110"
Jul 28 21:05:32.876307 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.876286    2555 generic.go:356] "Generic (PLEG): container finished" podID="40bedbf6-bd75-47cb-aedf-5615cddab561" containerID="192ebbdad4b427d29f9967c49c12c79336ed3dbe9d618a9bf70aa5817397d92d" exitCode=0
Jul 28 21:05:32.876408 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.876326    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"
Jul 28 21:05:32.876408 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.876346    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9" event={"ID":"40bedbf6-bd75-47cb-aedf-5615cddab561","Type":"ContainerDied","Data":"192ebbdad4b427d29f9967c49c12c79336ed3dbe9d618a9bf70aa5817397d92d"}
Jul 28 21:05:32.876408 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.876381    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9" event={"ID":"40bedbf6-bd75-47cb-aedf-5615cddab561","Type":"ContainerDied","Data":"09850dee8ae51279c3f32a13f55c155b9695ca368f75fa132a5082b5c8097b9c"}
Jul 28 21:05:32.891772 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.891743    2555 scope.go:117] "RemoveContainer" containerID="027929bf1750c980f960f2ae57dd423efebf6ba4c4ac8f33d90eeb0b4d0d0110"
Jul 28 21:05:32.892179 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:05:32.892151    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"027929bf1750c980f960f2ae57dd423efebf6ba4c4ac8f33d90eeb0b4d0d0110\": container with ID starting with 027929bf1750c980f960f2ae57dd423efebf6ba4c4ac8f33d90eeb0b4d0d0110 not found: ID does not exist" containerID="027929bf1750c980f960f2ae57dd423efebf6ba4c4ac8f33d90eeb0b4d0d0110"
Jul 28 21:05:32.892268 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.892187    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"027929bf1750c980f960f2ae57dd423efebf6ba4c4ac8f33d90eeb0b4d0d0110"} err="failed to get container status \"027929bf1750c980f960f2ae57dd423efebf6ba4c4ac8f33d90eeb0b4d0d0110\": rpc error: code = NotFound desc = could not find container \"027929bf1750c980f960f2ae57dd423efebf6ba4c4ac8f33d90eeb0b4d0d0110\": container with ID starting with 027929bf1750c980f960f2ae57dd423efebf6ba4c4ac8f33d90eeb0b4d0d0110 not found: ID does not exist"
Jul 28 21:05:32.892268 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.892204    2555 scope.go:117] "RemoveContainer" containerID="192ebbdad4b427d29f9967c49c12c79336ed3dbe9d618a9bf70aa5817397d92d"
Jul 28 21:05:32.900375 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.900352    2555 scope.go:117] "RemoveContainer" containerID="192ebbdad4b427d29f9967c49c12c79336ed3dbe9d618a9bf70aa5817397d92d"
Jul 28 21:05:32.900629 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.900608    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"]
Jul 28 21:05:32.900697 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:05:32.900624    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"192ebbdad4b427d29f9967c49c12c79336ed3dbe9d618a9bf70aa5817397d92d\": container with ID starting with 192ebbdad4b427d29f9967c49c12c79336ed3dbe9d618a9bf70aa5817397d92d not found: ID does not exist" containerID="192ebbdad4b427d29f9967c49c12c79336ed3dbe9d618a9bf70aa5817397d92d"
Jul 28 21:05:32.900697 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.900660    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"192ebbdad4b427d29f9967c49c12c79336ed3dbe9d618a9bf70aa5817397d92d"} err="failed to get container status \"192ebbdad4b427d29f9967c49c12c79336ed3dbe9d618a9bf70aa5817397d92d\": rpc error: code = NotFound desc = could not find container \"192ebbdad4b427d29f9967c49c12c79336ed3dbe9d618a9bf70aa5817397d92d\": container with ID starting with 192ebbdad4b427d29f9967c49c12c79336ed3dbe9d618a9bf70aa5817397d92d not found: ID does not exist"
Jul 28 21:05:32.904647 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.904625    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9"]
Jul 28 21:05:32.915786 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.915765    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"]
Jul 28 21:05:32.918347 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:32.918327    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-8e6a5a-57f87c98d-sl5zf"]
Jul 28 21:05:33.524998 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:33.524890    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-a-8e6a5a-5f56bbd7b8-v5kb9" podUID="40bedbf6-bd75-47cb-aedf-5615cddab561" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.55:9004: i/o timeout"
Jul 28 21:05:34.296023 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:34.295989    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40bedbf6-bd75-47cb-aedf-5615cddab561" path="/var/lib/kubelet/pods/40bedbf6-bd75-47cb-aedf-5615cddab561/volumes"
Jul 28 21:05:34.296377 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:34.296363    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8" path="/var/lib/kubelet/pods/94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8/volumes"
Jul 28 21:05:34.898524 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:34.898488    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:05:54.888414 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:54.888369    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"]
Jul 28 21:05:54.889089 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:54.889032    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl" podUID="9101d45d-6fb7-40f9-9ec8-7c80ed87f80a" containerName="payload-processing" containerID="cri-o://f8166f05aaecd82f54daa9cc1a33725ba0743473bc8bb9fa67f66ec92e0bb63e" gracePeriod=30
Jul 28 21:05:54.895498 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:54.895466    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"]
Jul 28 21:05:54.895702 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:54.895678    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2" podUID="8b0be7c6-74b0-42e3-ac79-8280767d1026" containerName="payload-pre-processing" containerID="cri-o://022cef702dd353b1b66be7f0d64bc7a5b6ffada99a5fc28c30af3705825300f2" gracePeriod=30
Jul 28 21:05:55.189690 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.189662    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"
Jul 28 21:05:55.192553 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.192528    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"
Jul 28 21:05:55.384765 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.384728    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b0be7c6-74b0-42e3-ac79-8280767d1026-plugins-config-volume\") pod \"8b0be7c6-74b0-42e3-ac79-8280767d1026\" (UID: \"8b0be7c6-74b0-42e3-ac79-8280767d1026\") "
Jul 28 21:05:55.385037 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.384777    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9101d45d-6fb7-40f9-9ec8-7c80ed87f80a-plugins-config-volume\") pod \"9101d45d-6fb7-40f9-9ec8-7c80ed87f80a\" (UID: \"9101d45d-6fb7-40f9-9ec8-7c80ed87f80a\") "
Jul 28 21:05:55.385037 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.384820    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z49kv\" (UniqueName: \"kubernetes.io/projected/8b0be7c6-74b0-42e3-ac79-8280767d1026-kube-api-access-z49kv\") pod \"8b0be7c6-74b0-42e3-ac79-8280767d1026\" (UID: \"8b0be7c6-74b0-42e3-ac79-8280767d1026\") "
Jul 28 21:05:55.385037 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.384849    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlmkb\" (UniqueName: \"kubernetes.io/projected/9101d45d-6fb7-40f9-9ec8-7c80ed87f80a-kube-api-access-qlmkb\") pod \"9101d45d-6fb7-40f9-9ec8-7c80ed87f80a\" (UID: \"9101d45d-6fb7-40f9-9ec8-7c80ed87f80a\") "
Jul 28 21:05:55.385248 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.385201    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b0be7c6-74b0-42e3-ac79-8280767d1026-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8b0be7c6-74b0-42e3-ac79-8280767d1026" (UID: "8b0be7c6-74b0-42e3-ac79-8280767d1026"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:05:55.385322 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.385294    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9101d45d-6fb7-40f9-9ec8-7c80ed87f80a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9101d45d-6fb7-40f9-9ec8-7c80ed87f80a" (UID: "9101d45d-6fb7-40f9-9ec8-7c80ed87f80a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:05:55.387059 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.387035    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9101d45d-6fb7-40f9-9ec8-7c80ed87f80a-kube-api-access-qlmkb" (OuterVolumeSpecName: "kube-api-access-qlmkb") pod "9101d45d-6fb7-40f9-9ec8-7c80ed87f80a" (UID: "9101d45d-6fb7-40f9-9ec8-7c80ed87f80a"). InnerVolumeSpecName "kube-api-access-qlmkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:05:55.387284 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.387263    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b0be7c6-74b0-42e3-ac79-8280767d1026-kube-api-access-z49kv" (OuterVolumeSpecName: "kube-api-access-z49kv") pod "8b0be7c6-74b0-42e3-ac79-8280767d1026" (UID: "8b0be7c6-74b0-42e3-ac79-8280767d1026"). InnerVolumeSpecName "kube-api-access-z49kv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:05:55.486538 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.486451    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b0be7c6-74b0-42e3-ac79-8280767d1026-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:05:55.486538 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.486485    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9101d45d-6fb7-40f9-9ec8-7c80ed87f80a-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:05:55.486538 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.486494    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z49kv\" (UniqueName: \"kubernetes.io/projected/8b0be7c6-74b0-42e3-ac79-8280767d1026-kube-api-access-z49kv\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:05:55.486538 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.486502    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlmkb\" (UniqueName: \"kubernetes.io/projected/9101d45d-6fb7-40f9-9ec8-7c80ed87f80a-kube-api-access-qlmkb\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:05:55.988676 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.988637    2555 generic.go:356] "Generic (PLEG): container finished" podID="8b0be7c6-74b0-42e3-ac79-8280767d1026" containerID="022cef702dd353b1b66be7f0d64bc7a5b6ffada99a5fc28c30af3705825300f2" exitCode=0
Jul 28 21:05:55.989190 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.988685    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"
Jul 28 21:05:55.989190 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.988725    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2" event={"ID":"8b0be7c6-74b0-42e3-ac79-8280767d1026","Type":"ContainerDied","Data":"022cef702dd353b1b66be7f0d64bc7a5b6ffada99a5fc28c30af3705825300f2"}
Jul 28 21:05:55.989190 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.988782    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2" event={"ID":"8b0be7c6-74b0-42e3-ac79-8280767d1026","Type":"ContainerDied","Data":"d763ec3080cf12c77c65ab891349320e3395875cbd0e54c16158ff5a7411082f"}
Jul 28 21:05:55.989190 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.988809    2555 scope.go:117] "RemoveContainer" containerID="022cef702dd353b1b66be7f0d64bc7a5b6ffada99a5fc28c30af3705825300f2"
Jul 28 21:05:55.990167 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.990106    2555 generic.go:356] "Generic (PLEG): container finished" podID="9101d45d-6fb7-40f9-9ec8-7c80ed87f80a" containerID="f8166f05aaecd82f54daa9cc1a33725ba0743473bc8bb9fa67f66ec92e0bb63e" exitCode=0
Jul 28 21:05:55.990167 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.990158    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"
Jul 28 21:05:55.990274 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.990188    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl" event={"ID":"9101d45d-6fb7-40f9-9ec8-7c80ed87f80a","Type":"ContainerDied","Data":"f8166f05aaecd82f54daa9cc1a33725ba0743473bc8bb9fa67f66ec92e0bb63e"}
Jul 28 21:05:55.990274 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.990245    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl" event={"ID":"9101d45d-6fb7-40f9-9ec8-7c80ed87f80a","Type":"ContainerDied","Data":"05298031d9a8c3d83ea67c5e85fa0b8b4d5962c578aad4c435f36e49be100122"}
Jul 28 21:05:55.999199 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.999182    2555 scope.go:117] "RemoveContainer" containerID="022cef702dd353b1b66be7f0d64bc7a5b6ffada99a5fc28c30af3705825300f2"
Jul 28 21:05:55.999484 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:05:55.999459    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"022cef702dd353b1b66be7f0d64bc7a5b6ffada99a5fc28c30af3705825300f2\": container with ID starting with 022cef702dd353b1b66be7f0d64bc7a5b6ffada99a5fc28c30af3705825300f2 not found: ID does not exist" containerID="022cef702dd353b1b66be7f0d64bc7a5b6ffada99a5fc28c30af3705825300f2"
Jul 28 21:05:55.999556 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.999495    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"022cef702dd353b1b66be7f0d64bc7a5b6ffada99a5fc28c30af3705825300f2"} err="failed to get container status \"022cef702dd353b1b66be7f0d64bc7a5b6ffada99a5fc28c30af3705825300f2\": rpc error: code = NotFound desc = could not find container \"022cef702dd353b1b66be7f0d64bc7a5b6ffada99a5fc28c30af3705825300f2\": container with ID starting with 022cef702dd353b1b66be7f0d64bc7a5b6ffada99a5fc28c30af3705825300f2 not found: ID does not exist"
Jul 28 21:05:55.999556 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:55.999519    2555 scope.go:117] "RemoveContainer" containerID="f8166f05aaecd82f54daa9cc1a33725ba0743473bc8bb9fa67f66ec92e0bb63e"
Jul 28 21:05:56.007741 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:56.007724    2555 scope.go:117] "RemoveContainer" containerID="f8166f05aaecd82f54daa9cc1a33725ba0743473bc8bb9fa67f66ec92e0bb63e"
Jul 28 21:05:56.008011 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:05:56.007990    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8166f05aaecd82f54daa9cc1a33725ba0743473bc8bb9fa67f66ec92e0bb63e\": container with ID starting with f8166f05aaecd82f54daa9cc1a33725ba0743473bc8bb9fa67f66ec92e0bb63e not found: ID does not exist" containerID="f8166f05aaecd82f54daa9cc1a33725ba0743473bc8bb9fa67f66ec92e0bb63e"
Jul 28 21:05:56.008081 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:56.008022    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8166f05aaecd82f54daa9cc1a33725ba0743473bc8bb9fa67f66ec92e0bb63e"} err="failed to get container status \"f8166f05aaecd82f54daa9cc1a33725ba0743473bc8bb9fa67f66ec92e0bb63e\": rpc error: code = NotFound desc = could not find container \"f8166f05aaecd82f54daa9cc1a33725ba0743473bc8bb9fa67f66ec92e0bb63e\": container with ID starting with f8166f05aaecd82f54daa9cc1a33725ba0743473bc8bb9fa67f66ec92e0bb63e not found: ID does not exist"
Jul 28 21:05:56.014988 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:56.014961    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"]
Jul 28 21:05:56.018481 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:56.018459    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fec7c6-6667cd99b8-2f9m2"]
Jul 28 21:05:56.027908 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:56.027888    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"]
Jul 28 21:05:56.032077 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:56.032045    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fec7c6-6c7db5fd98-7rqbl"]
Jul 28 21:05:56.295536 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:56.295442    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b0be7c6-74b0-42e3-ac79-8280767d1026" path="/var/lib/kubelet/pods/8b0be7c6-74b0-42e3-ac79-8280767d1026/volumes"
Jul 28 21:05:56.295905 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:56.295883    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9101d45d-6fb7-40f9-9ec8-7c80ed87f80a" path="/var/lib/kubelet/pods/9101d45d-6fb7-40f9-9ec8-7c80ed87f80a/volumes"
Jul 28 21:05:59.503238 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:05:59.503203    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:06:02.376582 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.376545    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"]
Jul 28 21:06:02.377020 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.376903    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40bedbf6-bd75-47cb-aedf-5615cddab561" containerName="payload-pre-processing"
Jul 28 21:06:02.377020 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.376914    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="40bedbf6-bd75-47cb-aedf-5615cddab561" containerName="payload-pre-processing"
Jul 28 21:06:02.377020 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.376926    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9101d45d-6fb7-40f9-9ec8-7c80ed87f80a" containerName="payload-processing"
Jul 28 21:06:02.377020 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.376956    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9101d45d-6fb7-40f9-9ec8-7c80ed87f80a" containerName="payload-processing"
Jul 28 21:06:02.377020 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.376966    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b0be7c6-74b0-42e3-ac79-8280767d1026" containerName="payload-pre-processing"
Jul 28 21:06:02.377020 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.376972    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b0be7c6-74b0-42e3-ac79-8280767d1026" containerName="payload-pre-processing"
Jul 28 21:06:02.377020 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.376988    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8" containerName="payload-processing"
Jul 28 21:06:02.377020 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.376993    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8" containerName="payload-processing"
Jul 28 21:06:02.377295 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.377044    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9101d45d-6fb7-40f9-9ec8-7c80ed87f80a" containerName="payload-processing"
Jul 28 21:06:02.377295 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.377055    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="40bedbf6-bd75-47cb-aedf-5615cddab561" containerName="payload-pre-processing"
Jul 28 21:06:02.377295 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.377061    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b0be7c6-74b0-42e3-ac79-8280767d1026" containerName="payload-pre-processing"
Jul 28 21:06:02.377295 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.377068    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="94a7b8ca-4d2d-4281-bd26-0ad8fda7e5a8" containerName="payload-processing"
Jul 28 21:06:02.381432 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.381412    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.383791 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.383769    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-96b3c5-openshift-default-dockercfg-nrf9k\""
Jul 28 21:06:02.391298 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.391272    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"]
Jul 28 21:06:02.441370 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.441319    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-workload-socket\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.441565 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.441413    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-credential-socket\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.441565 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.441443    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istiod-ca-cert\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.441565 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.441464    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfgkt\" (UniqueName: \"kubernetes.io/projected/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-kube-api-access-wfgkt\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.441565 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.441494    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-data\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.441565 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.441515    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-envoy\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.441782 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.441619    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-workload-certs\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.441782 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.441662    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-token\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.441782 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.441718    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-podinfo\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.542752 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.542703    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-workload-socket\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.542969 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.542767    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-credential-socket\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.542969 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.542802    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istiod-ca-cert\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.542969 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.542828    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfgkt\" (UniqueName: \"kubernetes.io/projected/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-kube-api-access-wfgkt\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.542969 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.542864    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-data\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.543214 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.543007    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-envoy\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.543214 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.543059    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-workload-certs\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.543214 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.543093    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-token\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.543214 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.543131    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-podinfo\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.543214 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.543181    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-credential-socket\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.543480 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.543458    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-workload-socket\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.543568 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.543512    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-workload-certs\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.543568 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.543562    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-data\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.543798 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.543777    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istiod-ca-cert\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.545610 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.545589    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-envoy\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.545610 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.545600    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-podinfo\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.551149 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.551119    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-token\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.551251 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.551187    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfgkt\" (UniqueName: \"kubernetes.io/projected/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-kube-api-access-wfgkt\") pod \"e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") " pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.693519 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.693435    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:02.830806 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.830749    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"]
Jul 28 21:06:02.833082 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:06:02.833055    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb9f589_5f45_4bc1_8756_6eb30253c3b3.slice/crio-38798f865a07d6665f909473daa0277615637cd2414780e8b385f1e49b33c1ed WatchSource:0}: Error finding container 38798f865a07d6665f909473daa0277615637cd2414780e8b385f1e49b33c1ed: Status 404 returned error can't find the container with id 38798f865a07d6665f909473daa0277615637cd2414780e8b385f1e49b33c1ed
Jul 28 21:06:02.835114 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.835083    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:06:02.835224 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.835146    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:06:02.835224 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:02.835174    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:06:03.027519 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:03.027419    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw" event={"ID":"6bb9f589-5f45-4bc1-8756-6eb30253c3b3","Type":"ContainerStarted","Data":"6e9e0d91e619c347b8652fadbbad105cdd5d00633cc499026f0cc1052880d955"}
Jul 28 21:06:03.027791 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:03.027756    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw" event={"ID":"6bb9f589-5f45-4bc1-8756-6eb30253c3b3","Type":"ContainerStarted","Data":"38798f865a07d6665f909473daa0277615637cd2414780e8b385f1e49b33c1ed"}
Jul 28 21:06:03.048073 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:03.048017    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw" podStartSLOduration=1.048001241 podStartE2EDuration="1.048001241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:06:03.046476817 +0000 UTC m=+2477.291853519" watchObservedRunningTime="2026-07-28 21:06:03.048001241 +0000 UTC m=+2477.293377943"
Jul 28 21:06:03.693564 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:03.693533    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:03.698616 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:03.698589    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:04.033251 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:04.033161    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:04.034105 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:04.034088    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:05.841648 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:05.841607    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"]
Jul 28 21:06:05.847244 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:05.847214    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"
Jul 28 21:06:05.847690 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:05.847588    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"]
Jul 28 21:06:05.849741 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:05.849715    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-96b3c5\""
Jul 28 21:06:05.849872 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:05.849771    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-96b3c5-dockercfg-tl8xg\""
Jul 28 21:06:05.866850 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:05.866811    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bmpr\" (UniqueName: \"kubernetes.io/projected/c000d44a-5737-41cd-9114-ad6088ac8b6f-kube-api-access-6bmpr\") pod \"payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j\" (UID: \"c000d44a-5737-41cd-9114-ad6088ac8b6f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"
Jul 28 21:06:05.867025 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:05.866909    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c000d44a-5737-41cd-9114-ad6088ac8b6f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j\" (UID: \"c000d44a-5737-41cd-9114-ad6088ac8b6f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"
Jul 28 21:06:05.968151 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:05.968108    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bmpr\" (UniqueName: \"kubernetes.io/projected/c000d44a-5737-41cd-9114-ad6088ac8b6f-kube-api-access-6bmpr\") pod \"payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j\" (UID: \"c000d44a-5737-41cd-9114-ad6088ac8b6f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"
Jul 28 21:06:05.968359 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:05.968171    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c000d44a-5737-41cd-9114-ad6088ac8b6f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j\" (UID: \"c000d44a-5737-41cd-9114-ad6088ac8b6f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"
Jul 28 21:06:05.969045 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:05.969018    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c000d44a-5737-41cd-9114-ad6088ac8b6f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j\" (UID: \"c000d44a-5737-41cd-9114-ad6088ac8b6f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"
Jul 28 21:06:05.979009 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:05.978985    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bmpr\" (UniqueName: \"kubernetes.io/projected/c000d44a-5737-41cd-9114-ad6088ac8b6f-kube-api-access-6bmpr\") pod \"payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j\" (UID: \"c000d44a-5737-41cd-9114-ad6088ac8b6f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"
Jul 28 21:06:06.159647 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:06.159561    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"
Jul 28 21:06:06.504107 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:06.504010    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"]
Jul 28 21:06:06.507026 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:06:06.506991    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc000d44a_5737_41cd_9114_ad6088ac8b6f.slice/crio-aa73f901166709b302bd1b5fbb358fe80700cd7eb512c684bdbf5ea1ac582c7c WatchSource:0}: Error finding container aa73f901166709b302bd1b5fbb358fe80700cd7eb512c684bdbf5ea1ac582c7c: Status 404 returned error can't find the container with id aa73f901166709b302bd1b5fbb358fe80700cd7eb512c684bdbf5ea1ac582c7c
Jul 28 21:06:07.048293 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:07.048258    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j" event={"ID":"c000d44a-5737-41cd-9114-ad6088ac8b6f","Type":"ContainerStarted","Data":"06318b2145d2bbeddc859a99d830652a215b3e7d85e8ea368141331cdb130d3a"}
Jul 28 21:06:07.048692 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:07.048313    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j" event={"ID":"c000d44a-5737-41cd-9114-ad6088ac8b6f","Type":"ContainerStarted","Data":"aa73f901166709b302bd1b5fbb358fe80700cd7eb512c684bdbf5ea1ac582c7c"}
Jul 28 21:06:07.048692 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:07.048346    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"
Jul 28 21:06:07.062595 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:07.062547    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j" podStartSLOduration=2.062529561 podStartE2EDuration="2.062529561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:06:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:06:07.062196215 +0000 UTC m=+2481.307572918" watchObservedRunningTime="2026-07-28 21:06:07.062529561 +0000 UTC m=+2481.307906264"
Jul 28 21:06:10.804089 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:10.804050    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:06:18.054759 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:18.054729    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"
Jul 28 21:06:19.035552 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:19.035445    2555 patch_prober.go:28] interesting pod/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 28 21:06:19.035552 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:19.035511    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw" podUID="6bb9f589-5f45-4bc1-8756-6eb30253c3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 28 21:06:19.108055 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:19.108015    2555 generic.go:356] "Generic (PLEG): container finished" podID="6bb9f589-5f45-4bc1-8756-6eb30253c3b3" containerID="6e9e0d91e619c347b8652fadbbad105cdd5d00633cc499026f0cc1052880d955" exitCode=0
Jul 28 21:06:19.108549 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:19.108092    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw" event={"ID":"6bb9f589-5f45-4bc1-8756-6eb30253c3b3","Type":"ContainerDied","Data":"6e9e0d91e619c347b8652fadbbad105cdd5d00633cc499026f0cc1052880d955"}
Jul 28 21:06:19.108634 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:19.108617    2555 scope.go:117] "RemoveContainer" containerID="6e9e0d91e619c347b8652fadbbad105cdd5d00633cc499026f0cc1052880d955"
Jul 28 21:06:19.109663 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:19.109634    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:06:19.109762 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:19.109700    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:06:19.109762 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:19.109736    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:06:20.115370 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:20.115320    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw" event={"ID":"6bb9f589-5f45-4bc1-8756-6eb30253c3b3","Type":"ContainerStarted","Data":"a29d0f94392da726ea1f07767dc96767f063021beda38316ebb1fea87367deb5"}
Jul 28 21:06:20.694132 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:20.694095    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:20.694326 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:20.694303    2555 patch_prober.go:28] interesting pod/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 28 21:06:20.694375 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:20.694353    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw" podUID="6bb9f589-5f45-4bc1-8756-6eb30253c3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 28 21:06:21.694553 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:21.694516    2555 patch_prober.go:28] interesting pod/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 28 21:06:21.694969 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:21.694570    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw" podUID="6bb9f589-5f45-4bc1-8756-6eb30253c3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 28 21:06:22.693818 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:22.693775    2555 patch_prober.go:28] interesting pod/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 28 21:06:22.694058 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:22.693853    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw" podUID="6bb9f589-5f45-4bc1-8756-6eb30253c3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 28 21:06:23.694350 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:23.694312    2555 patch_prober.go:28] interesting pod/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 28 21:06:23.694760 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:23.694367    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw" podUID="6bb9f589-5f45-4bc1-8756-6eb30253c3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 28 21:06:24.698173 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:24.698134    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:24.698649 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:24.698420    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:24.699158 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:24.699140    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:06:35.005631 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.005595    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"]
Jul 28 21:06:35.009068 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.009051    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"
Jul 28 21:06:35.011408 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.011384    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-4e7a7a-dockercfg-wc7sp\""
Jul 28 21:06:35.011519 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.011481    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-4e7a7a\""
Jul 28 21:06:35.017306 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.017279    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"]
Jul 28 21:06:35.051014 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.050981    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"]
Jul 28 21:06:35.054406 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.054390    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"
Jul 28 21:06:35.062567 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.062539    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"]
Jul 28 21:06:35.149077 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.149043    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtdjv\" (UniqueName: \"kubernetes.io/projected/a9ce6bc0-a3af-4151-a91b-7bec9f6cf051-kube-api-access-gtdjv\") pod \"payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b\" (UID: \"a9ce6bc0-a3af-4151-a91b-7bec9f6cf051\") " pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"
Jul 28 21:06:35.149261 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.149110    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm9q7\" (UniqueName: \"kubernetes.io/projected/c655df5e-c50e-4945-a301-6a086b14dce4-kube-api-access-bm9q7\") pod \"payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4\" (UID: \"c655df5e-c50e-4945-a301-6a086b14dce4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"
Jul 28 21:06:35.149261 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.149149    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c655df5e-c50e-4945-a301-6a086b14dce4-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4\" (UID: \"c655df5e-c50e-4945-a301-6a086b14dce4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"
Jul 28 21:06:35.149261 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.149226    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9ce6bc0-a3af-4151-a91b-7bec9f6cf051-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b\" (UID: \"a9ce6bc0-a3af-4151-a91b-7bec9f6cf051\") " pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"
Jul 28 21:06:35.250294 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.250239    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9ce6bc0-a3af-4151-a91b-7bec9f6cf051-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b\" (UID: \"a9ce6bc0-a3af-4151-a91b-7bec9f6cf051\") " pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"
Jul 28 21:06:35.250294 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.250301    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtdjv\" (UniqueName: \"kubernetes.io/projected/a9ce6bc0-a3af-4151-a91b-7bec9f6cf051-kube-api-access-gtdjv\") pod \"payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b\" (UID: \"a9ce6bc0-a3af-4151-a91b-7bec9f6cf051\") " pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"
Jul 28 21:06:35.250573 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.250355    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm9q7\" (UniqueName: \"kubernetes.io/projected/c655df5e-c50e-4945-a301-6a086b14dce4-kube-api-access-bm9q7\") pod \"payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4\" (UID: \"c655df5e-c50e-4945-a301-6a086b14dce4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"
Jul 28 21:06:35.250573 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.250382    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c655df5e-c50e-4945-a301-6a086b14dce4-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4\" (UID: \"c655df5e-c50e-4945-a301-6a086b14dce4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"
Jul 28 21:06:35.251257 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.251232    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c655df5e-c50e-4945-a301-6a086b14dce4-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4\" (UID: \"c655df5e-c50e-4945-a301-6a086b14dce4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"
Jul 28 21:06:35.251324 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.251232    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9ce6bc0-a3af-4151-a91b-7bec9f6cf051-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b\" (UID: \"a9ce6bc0-a3af-4151-a91b-7bec9f6cf051\") " pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"
Jul 28 21:06:35.258036 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.257981    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtdjv\" (UniqueName: \"kubernetes.io/projected/a9ce6bc0-a3af-4151-a91b-7bec9f6cf051-kube-api-access-gtdjv\") pod \"payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b\" (UID: \"a9ce6bc0-a3af-4151-a91b-7bec9f6cf051\") " pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"
Jul 28 21:06:35.258148 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.258131    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm9q7\" (UniqueName: \"kubernetes.io/projected/c655df5e-c50e-4945-a301-6a086b14dce4-kube-api-access-bm9q7\") pod \"payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4\" (UID: \"c655df5e-c50e-4945-a301-6a086b14dce4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"
Jul 28 21:06:35.321619 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.321576    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"
Jul 28 21:06:35.366001 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.365968    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"
Jul 28 21:06:35.519293 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.519269    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"]
Jul 28 21:06:35.523744 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:06:35.523712    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc655df5e_c50e_4945_a301_6a086b14dce4.slice/crio-582b1bae3db826e1f10736c9046b006f43d55e4265f56e0030a5abdeb6138874 WatchSource:0}: Error finding container 582b1bae3db826e1f10736c9046b006f43d55e4265f56e0030a5abdeb6138874: Status 404 returned error can't find the container with id 582b1bae3db826e1f10736c9046b006f43d55e4265f56e0030a5abdeb6138874
Jul 28 21:06:35.670241 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:35.670214    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"]
Jul 28 21:06:35.672062 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:06:35.672038    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ce6bc0_a3af_4151_a91b_7bec9f6cf051.slice/crio-970e5524a127236e64ed2efdbb7d9914d2f8128344917a8aa2e364fe4b53e890 WatchSource:0}: Error finding container 970e5524a127236e64ed2efdbb7d9914d2f8128344917a8aa2e364fe4b53e890: Status 404 returned error can't find the container with id 970e5524a127236e64ed2efdbb7d9914d2f8128344917a8aa2e364fe4b53e890
Jul 28 21:06:36.202549 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:36.202501    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b" event={"ID":"a9ce6bc0-a3af-4151-a91b-7bec9f6cf051","Type":"ContainerStarted","Data":"6af7d7cb6cb16e672ad932c6fd90dc4f75a435560b631571302c0161a5b67a61"}
Jul 28 21:06:36.203121 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:36.202601    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"
Jul 28 21:06:36.203121 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:36.202624    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b" event={"ID":"a9ce6bc0-a3af-4151-a91b-7bec9f6cf051","Type":"ContainerStarted","Data":"970e5524a127236e64ed2efdbb7d9914d2f8128344917a8aa2e364fe4b53e890"}
Jul 28 21:06:36.204578 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:36.204546    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4" event={"ID":"c655df5e-c50e-4945-a301-6a086b14dce4","Type":"ContainerStarted","Data":"495609441e9a8c7bddc322e87ee42804dc93a111b907957fc0ce94178ade5e48"}
Jul 28 21:06:36.204720 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:36.204603    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4" event={"ID":"c655df5e-c50e-4945-a301-6a086b14dce4","Type":"ContainerStarted","Data":"582b1bae3db826e1f10736c9046b006f43d55e4265f56e0030a5abdeb6138874"}
Jul 28 21:06:36.204720 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:36.204649    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"
Jul 28 21:06:36.221844 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:36.221785    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b" podStartSLOduration=2.22176375 podStartE2EDuration="2.22176375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:06:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:06:36.218296547 +0000 UTC m=+2510.463673248" watchObservedRunningTime="2026-07-28 21:06:36.22176375 +0000 UTC m=+2510.467140459"
Jul 28 21:06:36.235901 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:36.235848    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4" podStartSLOduration=1.235832928 podStartE2EDuration="1.235832928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:06:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:06:36.234147933 +0000 UTC m=+2510.479524636" watchObservedRunningTime="2026-07-28 21:06:36.235832928 +0000 UTC m=+2510.481209630"
Jul 28 21:06:41.204586 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:41.204487    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:06:47.213606 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:47.213575    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"
Jul 28 21:06:47.214085 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:06:47.213658    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"
Jul 28 21:07:08.108842 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.108806    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"]
Jul 28 21:07:08.112572 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.112549    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.116178 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.116154    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-96b3c5\"/\"kube-root-ca.crt\""
Jul 28 21:07:08.116178 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.116184    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-96b3c5\"/\"auth-test-model-96b3c5-kserve-self-signed-certs\""
Jul 28 21:07:08.116398 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.116206    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-96b3c5\"/\"default-dockercfg-zd6sm\""
Jul 28 21:07:08.116398 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.116258    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-96b3c5\"/\"openshift-service-ca.crt\""
Jul 28 21:07:08.120350 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.120199    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"]
Jul 28 21:07:08.250641 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.250599    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-model-cache\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.250641 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.250647    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-tmp-dir\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.250912 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.250783    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-dshm\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.250912 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.250893    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-tls-certs\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.251037 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.250923    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-home\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.251037 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.250999    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75scq\" (UniqueName: \"kubernetes.io/projected/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-kube-api-access-75scq\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.352209 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.352171    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-dshm\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.352417 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.352260    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-tls-certs\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.352417 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.352280    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-home\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.352417 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.352317    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75scq\" (UniqueName: \"kubernetes.io/projected/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-kube-api-access-75scq\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.352417 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.352335    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-model-cache\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.352417 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.352360    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-tmp-dir\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.352716 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.352693    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-home\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.352716 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.352709    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-tmp-dir\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.352802 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.352753    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-model-cache\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.354634 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.354608    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-dshm\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.355038 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.355015    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-tls-certs\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.360513 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.360440    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75scq\" (UniqueName: \"kubernetes.io/projected/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-kube-api-access-75scq\") pod \"auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") " pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.423340 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.423297    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:08.561434 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:08.561410    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"]
Jul 28 21:07:08.563816 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:07:08.563786    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf88ecaa5_7a60_4dd7_8526_0b5c32cb1cff.slice/crio-f2632d6ccd084d44913d7a04bfdbfa0aa89a336285c05be94d51e5a308c76d43 WatchSource:0}: Error finding container f2632d6ccd084d44913d7a04bfdbfa0aa89a336285c05be94d51e5a308c76d43: Status 404 returned error can't find the container with id f2632d6ccd084d44913d7a04bfdbfa0aa89a336285c05be94d51e5a308c76d43
Jul 28 21:07:09.372206 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:09.372166    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf" event={"ID":"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff","Type":"ContainerStarted","Data":"9a8a4c2f89d5aad2a72e6c9b5f3c73321fe868298f46a88194a8211a117d1f79"}
Jul 28 21:07:09.372597 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:09.372217    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf" event={"ID":"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff","Type":"ContainerStarted","Data":"f2632d6ccd084d44913d7a04bfdbfa0aa89a336285c05be94d51e5a308c76d43"}
Jul 28 21:07:09.389586 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:09.389529    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf" podStartSLOduration=1.389512654 podStartE2EDuration="1.389512654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:07:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:07:09.388179708 +0000 UTC m=+2543.633556411" watchObservedRunningTime="2026-07-28 21:07:09.389512654 +0000 UTC m=+2543.634889357"
Jul 28 21:07:11.402116 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:11.402083    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:07:18.424215 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:18.424185    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:18.424691 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:18.424447    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:18.436954 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:18.436917    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:19.432322 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:19.432292    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:07:37.598000 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:07:37.597965    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:08:05.492034 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:08:05.491999    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:08:27.595997 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:08:27.595960    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:08:45.392854 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:08:45.392812    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:09:10.403574 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:09:10.403536    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:09:30.297334 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:09:30.297294    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:09:46.448581 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:09:46.448499    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 21:09:46.453636 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:09:46.453612    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 21:09:51.903088 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:09:51.903037    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:10:09.891683 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:10:09.891649    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:10:33.407214 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:10:33.407169    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:10:50.998474 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:10:50.998439    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:11:13.492510 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:11:13.492433    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:11:32.097376 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:11:32.097342    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:11:59.303033 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:11:59.302995    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:12:04.063271 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:04.063233    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"]
Jul 28 21:12:17.004231 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:17.004195    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:12:19.082602 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.082564    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf" podUID="f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff" containerName="main" containerID="cri-o://9a8a4c2f89d5aad2a72e6c9b5f3c73321fe868298f46a88194a8211a117d1f79" gracePeriod=45
Jul 28 21:12:19.353235 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.353209    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:12:19.449882 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.449843    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-tmp-dir\") pod \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") "
Jul 28 21:12:19.449882 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.449890    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-home\") pod \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") "
Jul 28 21:12:19.450153 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.449966    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-model-cache\") pod \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") "
Jul 28 21:12:19.450153 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.449992    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75scq\" (UniqueName: \"kubernetes.io/projected/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-kube-api-access-75scq\") pod \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") "
Jul 28 21:12:19.450153 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.450061    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-dshm\") pod \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") "
Jul 28 21:12:19.450153 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.450114    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-tls-certs\") pod \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\" (UID: \"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff\") "
Jul 28 21:12:19.450381 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.450211    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-home" (OuterVolumeSpecName: "home") pod "f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff" (UID: "f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:12:19.450381 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.450225    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-model-cache" (OuterVolumeSpecName: "model-cache") pod "f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff" (UID: "f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:12:19.450381 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.450209    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff" (UID: "f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:12:19.450514 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.450439    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-tmp-dir\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:12:19.450514 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.450468    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-home\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:12:19.450514 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.450485    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-model-cache\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:12:19.452262 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.452240    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-kube-api-access-75scq" (OuterVolumeSpecName: "kube-api-access-75scq") pod "f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff" (UID: "f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff"). InnerVolumeSpecName "kube-api-access-75scq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:12:19.452371 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.452350    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff" (UID: "f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:12:19.452420 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.452350    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-dshm" (OuterVolumeSpecName: "dshm") pod "f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff" (UID: "f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:12:19.551307 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.551262    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75scq\" (UniqueName: \"kubernetes.io/projected/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-kube-api-access-75scq\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:12:19.551307 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.551304    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-dshm\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:12:19.551307 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.551317    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff-tls-certs\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:12:19.889212 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.889176    2555 generic.go:356] "Generic (PLEG): container finished" podID="f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff" containerID="9a8a4c2f89d5aad2a72e6c9b5f3c73321fe868298f46a88194a8211a117d1f79" exitCode=0
Jul 28 21:12:19.889390 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.889224    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"
Jul 28 21:12:19.889390 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.889249    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf" event={"ID":"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff","Type":"ContainerDied","Data":"9a8a4c2f89d5aad2a72e6c9b5f3c73321fe868298f46a88194a8211a117d1f79"}
Jul 28 21:12:19.889390 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.889280    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf" event={"ID":"f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff","Type":"ContainerDied","Data":"f2632d6ccd084d44913d7a04bfdbfa0aa89a336285c05be94d51e5a308c76d43"}
Jul 28 21:12:19.889390 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.889297    2555 scope.go:117] "RemoveContainer" containerID="9a8a4c2f89d5aad2a72e6c9b5f3c73321fe868298f46a88194a8211a117d1f79"
Jul 28 21:12:19.899014 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.898995    2555 scope.go:117] "RemoveContainer" containerID="9a8a4c2f89d5aad2a72e6c9b5f3c73321fe868298f46a88194a8211a117d1f79"
Jul 28 21:12:19.899279 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:12:19.899259    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a8a4c2f89d5aad2a72e6c9b5f3c73321fe868298f46a88194a8211a117d1f79\": container with ID starting with 9a8a4c2f89d5aad2a72e6c9b5f3c73321fe868298f46a88194a8211a117d1f79 not found: ID does not exist" containerID="9a8a4c2f89d5aad2a72e6c9b5f3c73321fe868298f46a88194a8211a117d1f79"
Jul 28 21:12:19.899347 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.899288    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a8a4c2f89d5aad2a72e6c9b5f3c73321fe868298f46a88194a8211a117d1f79"} err="failed to get container status \"9a8a4c2f89d5aad2a72e6c9b5f3c73321fe868298f46a88194a8211a117d1f79\": rpc error: code = NotFound desc = could not find container \"9a8a4c2f89d5aad2a72e6c9b5f3c73321fe868298f46a88194a8211a117d1f79\": container with ID starting with 9a8a4c2f89d5aad2a72e6c9b5f3c73321fe868298f46a88194a8211a117d1f79 not found: ID does not exist"
Jul 28 21:12:19.910920 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.910897    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"]
Jul 28 21:12:19.916116 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:19.916092    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/auth-test-model-96b3c5-kserve-854ffc89c9-4qpxf"]
Jul 28 21:12:20.296067 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:20.295987    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff" path="/var/lib/kubelet/pods/f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff/volumes"
Jul 28 21:12:24.433856 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.433817    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"]
Jul 28 21:12:24.434489 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.434438    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff" containerName="main"
Jul 28 21:12:24.434489 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.434460    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff" containerName="main"
Jul 28 21:12:24.434652 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.434576    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f88ecaa5-7a60-4dd7-8526-0b5c32cb1cff" containerName="main"
Jul 28 21:12:24.439040 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.439018    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.441632 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.441610    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-96b3c5\"/\"default-dockercfg-zd6sm\""
Jul 28 21:12:24.441744 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.441614    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-96b3c5\"/\"openshift-service-ca.crt\""
Jul 28 21:12:24.442556 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.442534    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-96b3c5\"/\"kube-root-ca.crt\""
Jul 28 21:12:24.442740 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.442721    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-96b3c5\"/\"sub-test-model-96b3c5-kserve-self-signed-certs\""
Jul 28 21:12:24.449051 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.449030    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"]
Jul 28 21:12:24.502414 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.502378    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-home\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.502588 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.502421    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-model-cache\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.502588 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.502531    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-dshm\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.502588 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.502563    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-tmp-dir\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.502750 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.502633    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ccdd12b-5b90-4070-8484-78c21ddc8536-tls-certs\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.502750 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.502663    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rjxh\" (UniqueName: \"kubernetes.io/projected/6ccdd12b-5b90-4070-8484-78c21ddc8536-kube-api-access-8rjxh\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.604154 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.604117    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-home\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.604154 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.604157    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-model-cache\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.604415 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.604209    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-dshm\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.604415 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.604226    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-tmp-dir\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.604415 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.604254    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ccdd12b-5b90-4070-8484-78c21ddc8536-tls-certs\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.604415 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.604270    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rjxh\" (UniqueName: \"kubernetes.io/projected/6ccdd12b-5b90-4070-8484-78c21ddc8536-kube-api-access-8rjxh\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.604631 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.604608    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-home\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.604696 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.604681    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-tmp-dir\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.604749 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.604730    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-model-cache\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.606545 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.606522    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-dshm\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.606743 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.606723    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ccdd12b-5b90-4070-8484-78c21ddc8536-tls-certs\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.613327 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.613303    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rjxh\" (UniqueName: \"kubernetes.io/projected/6ccdd12b-5b90-4070-8484-78c21ddc8536-kube-api-access-8rjxh\") pod \"sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") " pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.748913 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.748820    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:24.898368 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.898338    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"]
Jul 28 21:12:24.901468 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:12:24.901441    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ccdd12b_5b90_4070_8484_78c21ddc8536.slice/crio-1af09a027408b0bf56f6f4c417e7552278dc38ff234f64682df10c632d25140b WatchSource:0}: Error finding container 1af09a027408b0bf56f6f4c417e7552278dc38ff234f64682df10c632d25140b: Status 404 returned error can't find the container with id 1af09a027408b0bf56f6f4c417e7552278dc38ff234f64682df10c632d25140b
Jul 28 21:12:24.915468 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:24.915440    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9" event={"ID":"6ccdd12b-5b90-4070-8484-78c21ddc8536","Type":"ContainerStarted","Data":"1af09a027408b0bf56f6f4c417e7552278dc38ff234f64682df10c632d25140b"}
Jul 28 21:12:25.921648 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:25.921608    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9" event={"ID":"6ccdd12b-5b90-4070-8484-78c21ddc8536","Type":"ContainerStarted","Data":"e01e9d632a8d45262048640081350c4b7a01bc92ebcb301cbbd245258d6e5033"}
Jul 28 21:12:25.939701 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:25.939646    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9" podStartSLOduration=1.939628625 podStartE2EDuration="1.939628625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:12:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:12:25.937723785 +0000 UTC m=+2860.183100489" watchObservedRunningTime="2026-07-28 21:12:25.939628625 +0000 UTC m=+2860.185005353"
Jul 28 21:12:29.401333 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:29.401294    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:12:34.749879 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:34.749844    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:34.750329 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:34.749889    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:34.762600 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:34.762568    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:12:34.977808 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:12:34.977774    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:13:23.398713 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:13:23.398676    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:13:54.894093 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:13:54.894054    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:14:15.097502 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:15.097466    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:14:21.231761 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:21.231725    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"]
Jul 28 21:14:34.899685 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:34.899647    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:14:36.252073 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.252008    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9" podUID="6ccdd12b-5b90-4070-8484-78c21ddc8536" containerName="main" containerID="cri-o://e01e9d632a8d45262048640081350c4b7a01bc92ebcb301cbbd245258d6e5033" gracePeriod=45
Jul 28 21:14:36.508406 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.508347    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:14:36.559275 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.559239    2555 generic.go:356] "Generic (PLEG): container finished" podID="6ccdd12b-5b90-4070-8484-78c21ddc8536" containerID="e01e9d632a8d45262048640081350c4b7a01bc92ebcb301cbbd245258d6e5033" exitCode=0
Jul 28 21:14:36.559455 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.559280    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"
Jul 28 21:14:36.559455 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.559298    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9" event={"ID":"6ccdd12b-5b90-4070-8484-78c21ddc8536","Type":"ContainerDied","Data":"e01e9d632a8d45262048640081350c4b7a01bc92ebcb301cbbd245258d6e5033"}
Jul 28 21:14:36.559455 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.559331    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9" event={"ID":"6ccdd12b-5b90-4070-8484-78c21ddc8536","Type":"ContainerDied","Data":"1af09a027408b0bf56f6f4c417e7552278dc38ff234f64682df10c632d25140b"}
Jul 28 21:14:36.559455 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.559354    2555 scope.go:117] "RemoveContainer" containerID="e01e9d632a8d45262048640081350c4b7a01bc92ebcb301cbbd245258d6e5033"
Jul 28 21:14:36.567888 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.567865    2555 scope.go:117] "RemoveContainer" containerID="e01e9d632a8d45262048640081350c4b7a01bc92ebcb301cbbd245258d6e5033"
Jul 28 21:14:36.568172 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:14:36.568153    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e01e9d632a8d45262048640081350c4b7a01bc92ebcb301cbbd245258d6e5033\": container with ID starting with e01e9d632a8d45262048640081350c4b7a01bc92ebcb301cbbd245258d6e5033 not found: ID does not exist" containerID="e01e9d632a8d45262048640081350c4b7a01bc92ebcb301cbbd245258d6e5033"
Jul 28 21:14:36.568244 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.568182    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e01e9d632a8d45262048640081350c4b7a01bc92ebcb301cbbd245258d6e5033"} err="failed to get container status \"e01e9d632a8d45262048640081350c4b7a01bc92ebcb301cbbd245258d6e5033\": rpc error: code = NotFound desc = could not find container \"e01e9d632a8d45262048640081350c4b7a01bc92ebcb301cbbd245258d6e5033\": container with ID starting with e01e9d632a8d45262048640081350c4b7a01bc92ebcb301cbbd245258d6e5033 not found: ID does not exist"
Jul 28 21:14:36.683528 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.683496    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-home\") pod \"6ccdd12b-5b90-4070-8484-78c21ddc8536\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") "
Jul 28 21:14:36.683691 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.683537    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-dshm\") pod \"6ccdd12b-5b90-4070-8484-78c21ddc8536\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") "
Jul 28 21:14:36.683691 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.683639    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-tmp-dir\") pod \"6ccdd12b-5b90-4070-8484-78c21ddc8536\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") "
Jul 28 21:14:36.683691 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.683662    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ccdd12b-5b90-4070-8484-78c21ddc8536-tls-certs\") pod \"6ccdd12b-5b90-4070-8484-78c21ddc8536\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") "
Jul 28 21:14:36.683849 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.683722    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rjxh\" (UniqueName: \"kubernetes.io/projected/6ccdd12b-5b90-4070-8484-78c21ddc8536-kube-api-access-8rjxh\") pod \"6ccdd12b-5b90-4070-8484-78c21ddc8536\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") "
Jul 28 21:14:36.683849 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.683800    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-model-cache\") pod \"6ccdd12b-5b90-4070-8484-78c21ddc8536\" (UID: \"6ccdd12b-5b90-4070-8484-78c21ddc8536\") "
Jul 28 21:14:36.683849 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.683798    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-home" (OuterVolumeSpecName: "home") pod "6ccdd12b-5b90-4070-8484-78c21ddc8536" (UID: "6ccdd12b-5b90-4070-8484-78c21ddc8536"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:14:36.684052 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.683961    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ccdd12b-5b90-4070-8484-78c21ddc8536" (UID: "6ccdd12b-5b90-4070-8484-78c21ddc8536"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:14:36.684124 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.684076    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ccdd12b-5b90-4070-8484-78c21ddc8536" (UID: "6ccdd12b-5b90-4070-8484-78c21ddc8536"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:14:36.684222 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.684205    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-tmp-dir\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:14:36.684268 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.684226    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-model-cache\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:14:36.684268 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.684239    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-home\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:14:36.685865 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.685843    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ccdd12b-5b90-4070-8484-78c21ddc8536-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ccdd12b-5b90-4070-8484-78c21ddc8536" (UID: "6ccdd12b-5b90-4070-8484-78c21ddc8536"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:14:36.685973 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.685922    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-dshm" (OuterVolumeSpecName: "dshm") pod "6ccdd12b-5b90-4070-8484-78c21ddc8536" (UID: "6ccdd12b-5b90-4070-8484-78c21ddc8536"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:14:36.685973 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.685959    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ccdd12b-5b90-4070-8484-78c21ddc8536-kube-api-access-8rjxh" (OuterVolumeSpecName: "kube-api-access-8rjxh") pod "6ccdd12b-5b90-4070-8484-78c21ddc8536" (UID: "6ccdd12b-5b90-4070-8484-78c21ddc8536"). InnerVolumeSpecName "kube-api-access-8rjxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:14:36.785337 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.785260    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ccdd12b-5b90-4070-8484-78c21ddc8536-dshm\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:14:36.785337 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.785286    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ccdd12b-5b90-4070-8484-78c21ddc8536-tls-certs\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:14:36.785337 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.785297    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rjxh\" (UniqueName: \"kubernetes.io/projected/6ccdd12b-5b90-4070-8484-78c21ddc8536-kube-api-access-8rjxh\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:14:36.881710 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.881681    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"]
Jul 28 21:14:36.885582 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:36.885556    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/sub-test-model-96b3c5-kserve-5ff76ffd87-rlfg9"]
Jul 28 21:14:38.295867 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:38.295828    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ccdd12b-5b90-4070-8484-78c21ddc8536" path="/var/lib/kubelet/pods/6ccdd12b-5b90-4070-8484-78c21ddc8536/volumes"
Jul 28 21:14:40.623589 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.623538    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"]
Jul 28 21:14:40.624030 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.623920    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ccdd12b-5b90-4070-8484-78c21ddc8536" containerName="main"
Jul 28 21:14:40.624030 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.623952    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ccdd12b-5b90-4070-8484-78c21ddc8536" containerName="main"
Jul 28 21:14:40.624121 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.624036    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ccdd12b-5b90-4070-8484-78c21ddc8536" containerName="main"
Jul 28 21:14:40.628488 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.628467    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.632158 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.632135    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-96b3c5\"/\"openshift-service-ca.crt\""
Jul 28 21:14:40.632283 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.632189    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-96b3c5\"/\"kube-root-ca.crt\""
Jul 28 21:14:40.632334 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.632278    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-96b3c5\"/\"default-dockercfg-zd6sm\""
Jul 28 21:14:40.632334 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.632285    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-96b3c5\"/\"rate-test-model-96b3c5-kserve-self-signed-certs\""
Jul 28 21:14:40.637897 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.637873    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"]
Jul 28 21:14:40.719798 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.719761    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-tmp-dir\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.720021 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.719822    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-home\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.720021 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.719868    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-dshm\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.720021 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.719889    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nszpw\" (UniqueName: \"kubernetes.io/projected/9246a7e6-bc64-427f-a9ac-a2e9cce55378-kube-api-access-nszpw\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.720021 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.719999    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-model-cache\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.720021 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.720015    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9246a7e6-bc64-427f-a9ac-a2e9cce55378-tls-certs\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.820562 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.820517    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-tmp-dir\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.820773 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.820587    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-home\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.820773 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.820641    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-dshm\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.820773 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.820669    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nszpw\" (UniqueName: \"kubernetes.io/projected/9246a7e6-bc64-427f-a9ac-a2e9cce55378-kube-api-access-nszpw\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.820773 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.820732    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-model-cache\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.820773 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.820755    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9246a7e6-bc64-427f-a9ac-a2e9cce55378-tls-certs\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.821086 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.821004    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-tmp-dir\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.821086 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.821058    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-home\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.821204 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.821129    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-model-cache\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.822899 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.822876    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-dshm\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.823257 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.823237    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9246a7e6-bc64-427f-a9ac-a2e9cce55378-tls-certs\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.829297 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.829273    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nszpw\" (UniqueName: \"kubernetes.io/projected/9246a7e6-bc64-427f-a9ac-a2e9cce55378-kube-api-access-nszpw\") pod \"rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") " pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:40.938708 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:40.938610    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:41.074614 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:41.074540    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"]
Jul 28 21:14:41.077025 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:14:41.076987    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9246a7e6_bc64_427f_a9ac_a2e9cce55378.slice/crio-b3329b1217b9c7d3a83a76f240341256af4f9824b1961eaac8ee3f5c4a680365 WatchSource:0}: Error finding container b3329b1217b9c7d3a83a76f240341256af4f9824b1961eaac8ee3f5c4a680365: Status 404 returned error can't find the container with id b3329b1217b9c7d3a83a76f240341256af4f9824b1961eaac8ee3f5c4a680365
Jul 28 21:14:41.585512 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:41.585471    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm" event={"ID":"9246a7e6-bc64-427f-a9ac-a2e9cce55378","Type":"ContainerStarted","Data":"dc68cb4156dbee70c088a4d2400fa9d81f873cbe89ff6b023da2db3f5d8c98d9"}
Jul 28 21:14:41.585512 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:41.585515    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm" event={"ID":"9246a7e6-bc64-427f-a9ac-a2e9cce55378","Type":"ContainerStarted","Data":"b3329b1217b9c7d3a83a76f240341256af4f9824b1961eaac8ee3f5c4a680365"}
Jul 28 21:14:41.602663 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:41.602607    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm" podStartSLOduration=1.60258981 podStartE2EDuration="1.60258981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:14:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:14:41.601424451 +0000 UTC m=+2995.846801155" watchObservedRunningTime="2026-07-28 21:14:41.60258981 +0000 UTC m=+2995.847966512"
Jul 28 21:14:42.904258 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:42.904221    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:14:46.477076 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:46.477050    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 21:14:46.483812 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:46.483787    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 21:14:50.939072 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:50.939009    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:50.939540 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:50.939182    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:50.952116 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:50.952086    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:14:51.648840 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:14:51.648811    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:15:15.801208 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:15:15.801171    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:15:56.899189 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:15:56.899103    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:16:11.905905 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:11.905864    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:16:30.702100 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:30.702064    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:16:34.928615 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:34.928575    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"]
Jul 28 21:16:48.595528 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:48.595494    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:16:49.948258 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:49.948184    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm" podUID="9246a7e6-bc64-427f-a9ac-a2e9cce55378" containerName="main" containerID="cri-o://dc68cb4156dbee70c088a4d2400fa9d81f873cbe89ff6b023da2db3f5d8c98d9" gracePeriod=45
Jul 28 21:16:50.202908 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.202838    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:16:50.222118 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.222079    2555 generic.go:356] "Generic (PLEG): container finished" podID="9246a7e6-bc64-427f-a9ac-a2e9cce55378" containerID="dc68cb4156dbee70c088a4d2400fa9d81f873cbe89ff6b023da2db3f5d8c98d9" exitCode=0
Jul 28 21:16:50.222284 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.222121    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm" event={"ID":"9246a7e6-bc64-427f-a9ac-a2e9cce55378","Type":"ContainerDied","Data":"dc68cb4156dbee70c088a4d2400fa9d81f873cbe89ff6b023da2db3f5d8c98d9"}
Jul 28 21:16:50.222284 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.222125    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"
Jul 28 21:16:50.222284 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.222152    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm" event={"ID":"9246a7e6-bc64-427f-a9ac-a2e9cce55378","Type":"ContainerDied","Data":"b3329b1217b9c7d3a83a76f240341256af4f9824b1961eaac8ee3f5c4a680365"}
Jul 28 21:16:50.222284 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.222168    2555 scope.go:117] "RemoveContainer" containerID="dc68cb4156dbee70c088a4d2400fa9d81f873cbe89ff6b023da2db3f5d8c98d9"
Jul 28 21:16:50.231854 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.231835    2555 scope.go:117] "RemoveContainer" containerID="dc68cb4156dbee70c088a4d2400fa9d81f873cbe89ff6b023da2db3f5d8c98d9"
Jul 28 21:16:50.232191 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:16:50.232171    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc68cb4156dbee70c088a4d2400fa9d81f873cbe89ff6b023da2db3f5d8c98d9\": container with ID starting with dc68cb4156dbee70c088a4d2400fa9d81f873cbe89ff6b023da2db3f5d8c98d9 not found: ID does not exist" containerID="dc68cb4156dbee70c088a4d2400fa9d81f873cbe89ff6b023da2db3f5d8c98d9"
Jul 28 21:16:50.232250 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.232200    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc68cb4156dbee70c088a4d2400fa9d81f873cbe89ff6b023da2db3f5d8c98d9"} err="failed to get container status \"dc68cb4156dbee70c088a4d2400fa9d81f873cbe89ff6b023da2db3f5d8c98d9\": rpc error: code = NotFound desc = could not find container \"dc68cb4156dbee70c088a4d2400fa9d81f873cbe89ff6b023da2db3f5d8c98d9\": container with ID starting with dc68cb4156dbee70c088a4d2400fa9d81f873cbe89ff6b023da2db3f5d8c98d9 not found: ID does not exist"
Jul 28 21:16:50.264715 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.264679    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nszpw\" (UniqueName: \"kubernetes.io/projected/9246a7e6-bc64-427f-a9ac-a2e9cce55378-kube-api-access-nszpw\") pod \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") "
Jul 28 21:16:50.264902 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.264732    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-home\") pod \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") "
Jul 28 21:16:50.264902 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.264788    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-tmp-dir\") pod \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") "
Jul 28 21:16:50.264902 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.264814    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-model-cache\") pod \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") "
Jul 28 21:16:50.264902 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.264850    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-dshm\") pod \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") "
Jul 28 21:16:50.265155 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.264906    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9246a7e6-bc64-427f-a9ac-a2e9cce55378-tls-certs\") pod \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\" (UID: \"9246a7e6-bc64-427f-a9ac-a2e9cce55378\") "
Jul 28 21:16:50.265214 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.265153    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-model-cache" (OuterVolumeSpecName: "model-cache") pod "9246a7e6-bc64-427f-a9ac-a2e9cce55378" (UID: "9246a7e6-bc64-427f-a9ac-a2e9cce55378"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:16:50.265214 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.265159    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-home" (OuterVolumeSpecName: "home") pod "9246a7e6-bc64-427f-a9ac-a2e9cce55378" (UID: "9246a7e6-bc64-427f-a9ac-a2e9cce55378"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:16:50.265214 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.265175    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9246a7e6-bc64-427f-a9ac-a2e9cce55378" (UID: "9246a7e6-bc64-427f-a9ac-a2e9cce55378"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:16:50.265354 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.265298    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-home\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:16:50.265354 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.265335    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-tmp-dir\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:16:50.265354 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.265349    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-model-cache\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:16:50.267081 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.267047    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-dshm" (OuterVolumeSpecName: "dshm") pod "9246a7e6-bc64-427f-a9ac-a2e9cce55378" (UID: "9246a7e6-bc64-427f-a9ac-a2e9cce55378"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:16:50.267081 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.267062    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9246a7e6-bc64-427f-a9ac-a2e9cce55378-kube-api-access-nszpw" (OuterVolumeSpecName: "kube-api-access-nszpw") pod "9246a7e6-bc64-427f-a9ac-a2e9cce55378" (UID: "9246a7e6-bc64-427f-a9ac-a2e9cce55378"). InnerVolumeSpecName "kube-api-access-nszpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:16:50.267252 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.267147    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9246a7e6-bc64-427f-a9ac-a2e9cce55378-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9246a7e6-bc64-427f-a9ac-a2e9cce55378" (UID: "9246a7e6-bc64-427f-a9ac-a2e9cce55378"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:16:50.366212 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.366171    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nszpw\" (UniqueName: \"kubernetes.io/projected/9246a7e6-bc64-427f-a9ac-a2e9cce55378-kube-api-access-nszpw\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:16:50.366212 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.366208    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9246a7e6-bc64-427f-a9ac-a2e9cce55378-dshm\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:16:50.366212 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.366217    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9246a7e6-bc64-427f-a9ac-a2e9cce55378-tls-certs\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:16:50.537258 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.537171    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"]
Jul 28 21:16:50.542894 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:50.542867    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-96b3c5/rate-test-model-96b3c5-kserve-5dcb45954c-cpqjm"]
Jul 28 21:16:52.296394 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:52.296361    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9246a7e6-bc64-427f-a9ac-a2e9cce55378" path="/var/lib/kubelet/pods/9246a7e6-bc64-427f-a9ac-a2e9cce55378/volumes"
Jul 28 21:16:59.926487 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:59.926447    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"]
Jul 28 21:16:59.926894 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:59.926831    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9246a7e6-bc64-427f-a9ac-a2e9cce55378" containerName="main"
Jul 28 21:16:59.926894 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:59.926842    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9246a7e6-bc64-427f-a9ac-a2e9cce55378" containerName="main"
Jul 28 21:16:59.927022 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:59.926918    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9246a7e6-bc64-427f-a9ac-a2e9cce55378" containerName="main"
Jul 28 21:16:59.930097 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:59.930079    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"
Jul 28 21:16:59.932513 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:59.932483    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-d6ef24\""
Jul 28 21:16:59.932664 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:59.932486    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-d6ef24-dockercfg-ltxgh\""
Jul 28 21:16:59.937379 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:59.937351    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"]
Jul 28 21:16:59.945230 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:59.945196    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"]
Jul 28 21:16:59.949588 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:59.949559    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"
Jul 28 21:16:59.959539 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:16:59.959506    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"]
Jul 28 21:17:00.068835 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:00.068784    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnjjv\" (UniqueName: \"kubernetes.io/projected/53fc55c4-d712-4be8-a402-164e8dc346d1-kube-api-access-fnjjv\") pod \"payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6\" (UID: \"53fc55c4-d712-4be8-a402-164e8dc346d1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"
Jul 28 21:17:00.069085 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:00.068862    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0781850-ac90-4ad5-8c62-0be429f9d9de-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp\" (UID: \"d0781850-ac90-4ad5-8c62-0be429f9d9de\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"
Jul 28 21:17:00.069085 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:00.068887    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53fc55c4-d712-4be8-a402-164e8dc346d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6\" (UID: \"53fc55c4-d712-4be8-a402-164e8dc346d1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"
Jul 28 21:17:00.069085 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:00.069000    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm8cx\" (UniqueName: \"kubernetes.io/projected/d0781850-ac90-4ad5-8c62-0be429f9d9de-kube-api-access-qm8cx\") pod \"payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp\" (UID: \"d0781850-ac90-4ad5-8c62-0be429f9d9de\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"
Jul 28 21:17:00.170023 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:00.169974    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnjjv\" (UniqueName: \"kubernetes.io/projected/53fc55c4-d712-4be8-a402-164e8dc346d1-kube-api-access-fnjjv\") pod \"payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6\" (UID: \"53fc55c4-d712-4be8-a402-164e8dc346d1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"
Jul 28 21:17:00.170248 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:00.170053    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0781850-ac90-4ad5-8c62-0be429f9d9de-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp\" (UID: \"d0781850-ac90-4ad5-8c62-0be429f9d9de\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"
Jul 28 21:17:00.170248 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:00.170071    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53fc55c4-d712-4be8-a402-164e8dc346d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6\" (UID: \"53fc55c4-d712-4be8-a402-164e8dc346d1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"
Jul 28 21:17:00.170248 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:00.170116    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm8cx\" (UniqueName: \"kubernetes.io/projected/d0781850-ac90-4ad5-8c62-0be429f9d9de-kube-api-access-qm8cx\") pod \"payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp\" (UID: \"d0781850-ac90-4ad5-8c62-0be429f9d9de\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"
Jul 28 21:17:00.170821 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:00.170800    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53fc55c4-d712-4be8-a402-164e8dc346d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6\" (UID: \"53fc55c4-d712-4be8-a402-164e8dc346d1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"
Jul 28 21:17:00.170873 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:00.170809    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0781850-ac90-4ad5-8c62-0be429f9d9de-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp\" (UID: \"d0781850-ac90-4ad5-8c62-0be429f9d9de\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"
Jul 28 21:17:00.178282 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:00.178214    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnjjv\" (UniqueName: \"kubernetes.io/projected/53fc55c4-d712-4be8-a402-164e8dc346d1-kube-api-access-fnjjv\") pod \"payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6\" (UID: \"53fc55c4-d712-4be8-a402-164e8dc346d1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"
Jul 28 21:17:00.178282 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:00.178230    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm8cx\" (UniqueName: \"kubernetes.io/projected/d0781850-ac90-4ad5-8c62-0be429f9d9de-kube-api-access-qm8cx\") pod \"payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp\" (UID: \"d0781850-ac90-4ad5-8c62-0be429f9d9de\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"
Jul 28 21:17:00.242531 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:00.242491    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"
Jul 28 21:17:00.261365 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:00.261336    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"
Jul 28 21:17:00.394714 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:00.394616    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"]
Jul 28 21:17:00.397640 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:17:00.397596    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53fc55c4_d712_4be8_a402_164e8dc346d1.slice/crio-66fed909628ab52c7c3411761e7657582d04b398d4c9122b9f8f3494253ff743 WatchSource:0}: Error finding container 66fed909628ab52c7c3411761e7657582d04b398d4c9122b9f8f3494253ff743: Status 404 returned error can't find the container with id 66fed909628ab52c7c3411761e7657582d04b398d4c9122b9f8f3494253ff743
Jul 28 21:17:00.420517 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:00.420480    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"]
Jul 28 21:17:00.433217 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:17:00.433185    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0781850_ac90_4ad5_8c62_0be429f9d9de.slice/crio-6a0cfb6543c149f289628c356755c1a78d9d3dbceb9aaacf53a55f0776e20e53 WatchSource:0}: Error finding container 6a0cfb6543c149f289628c356755c1a78d9d3dbceb9aaacf53a55f0776e20e53: Status 404 returned error can't find the container with id 6a0cfb6543c149f289628c356755c1a78d9d3dbceb9aaacf53a55f0776e20e53
Jul 28 21:17:01.279717 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:01.279668    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp" event={"ID":"d0781850-ac90-4ad5-8c62-0be429f9d9de","Type":"ContainerStarted","Data":"092af3310a57c1df0785a46b6ae753b813a1be1100ea0ecb909a21fbb2e361b5"}
Jul 28 21:17:01.280279 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:01.279739    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp" event={"ID":"d0781850-ac90-4ad5-8c62-0be429f9d9de","Type":"ContainerStarted","Data":"6a0cfb6543c149f289628c356755c1a78d9d3dbceb9aaacf53a55f0776e20e53"}
Jul 28 21:17:01.280279 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:01.279767    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"
Jul 28 21:17:01.281197 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:01.281173    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6" event={"ID":"53fc55c4-d712-4be8-a402-164e8dc346d1","Type":"ContainerStarted","Data":"de7055def77c924ce6ab88b3159edd6c89d5e33483c164da2ff79e72ef334672"}
Jul 28 21:17:01.281327 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:01.281225    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6" event={"ID":"53fc55c4-d712-4be8-a402-164e8dc346d1","Type":"ContainerStarted","Data":"66fed909628ab52c7c3411761e7657582d04b398d4c9122b9f8f3494253ff743"}
Jul 28 21:17:01.281327 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:01.281257    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"
Jul 28 21:17:01.297036 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:01.296974    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp" podStartSLOduration=2.2969562310000002 podStartE2EDuration="2.296956231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:16:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:17:01.29412053 +0000 UTC m=+3135.539497233" watchObservedRunningTime="2026-07-28 21:17:01.296956231 +0000 UTC m=+3135.542332924"
Jul 28 21:17:01.309233 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:01.309184    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6" podStartSLOduration=2.309168319 podStartE2EDuration="2.309168319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:16:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:17:01.308264217 +0000 UTC m=+3135.553640919" watchObservedRunningTime="2026-07-28 21:17:01.309168319 +0000 UTC m=+3135.554545056"
Jul 28 21:17:07.700584 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:07.700539    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:17:12.288039 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:12.287921    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"
Jul 28 21:17:12.288442 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:12.288128    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"
Jul 28 21:17:28.951435 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:28.951395    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"]
Jul 28 21:17:28.955127 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:28.955108    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"
Jul 28 21:17:28.957444 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:28.957426    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-590ada\""
Jul 28 21:17:28.965485 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:28.965457    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"]
Jul 28 21:17:29.040146 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:29.040115    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbaa8510-65dc-4822-9d78-067ffb13c6ee-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq\" (UID: \"fbaa8510-65dc-4822-9d78-067ffb13c6ee\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"
Jul 28 21:17:29.040348 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:29.040152    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k78k\" (UniqueName: \"kubernetes.io/projected/fbaa8510-65dc-4822-9d78-067ffb13c6ee-kube-api-access-6k78k\") pod \"payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq\" (UID: \"fbaa8510-65dc-4822-9d78-067ffb13c6ee\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"
Jul 28 21:17:29.141526 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:29.141493    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbaa8510-65dc-4822-9d78-067ffb13c6ee-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq\" (UID: \"fbaa8510-65dc-4822-9d78-067ffb13c6ee\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"
Jul 28 21:17:29.141526 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:29.141531    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k78k\" (UniqueName: \"kubernetes.io/projected/fbaa8510-65dc-4822-9d78-067ffb13c6ee-kube-api-access-6k78k\") pod \"payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq\" (UID: \"fbaa8510-65dc-4822-9d78-067ffb13c6ee\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"
Jul 28 21:17:29.142260 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:29.142237    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbaa8510-65dc-4822-9d78-067ffb13c6ee-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq\" (UID: \"fbaa8510-65dc-4822-9d78-067ffb13c6ee\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"
Jul 28 21:17:29.149908 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:29.149880    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k78k\" (UniqueName: \"kubernetes.io/projected/fbaa8510-65dc-4822-9d78-067ffb13c6ee-kube-api-access-6k78k\") pod \"payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq\" (UID: \"fbaa8510-65dc-4822-9d78-067ffb13c6ee\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"
Jul 28 21:17:29.267129 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:29.267009    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"
Jul 28 21:17:29.405990 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:29.405959    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"]
Jul 28 21:17:29.408794 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:17:29.408764    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbaa8510_65dc_4822_9d78_067ffb13c6ee.slice/crio-95dd0d090581bd78a54b145cfb4ac4ed22e13649c2cc8f7f1d6dcd2d5a875eab WatchSource:0}: Error finding container 95dd0d090581bd78a54b145cfb4ac4ed22e13649c2cc8f7f1d6dcd2d5a875eab: Status 404 returned error can't find the container with id 95dd0d090581bd78a54b145cfb4ac4ed22e13649c2cc8f7f1d6dcd2d5a875eab
Jul 28 21:17:29.419916 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:29.419003    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq" event={"ID":"fbaa8510-65dc-4822-9d78-067ffb13c6ee","Type":"ContainerStarted","Data":"95dd0d090581bd78a54b145cfb4ac4ed22e13649c2cc8f7f1d6dcd2d5a875eab"}
Jul 28 21:17:30.425340 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:30.425303    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq" event={"ID":"fbaa8510-65dc-4822-9d78-067ffb13c6ee","Type":"ContainerStarted","Data":"660cbd9724a94de81d79ba9767dbe4c9555765448500cf997ea310c5fa8205b5"}
Jul 28 21:17:30.425797 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:30.425442    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"
Jul 28 21:17:30.441017 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:30.440965    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq" podStartSLOduration=2.440950019 podStartE2EDuration="2.440950019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:17:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:17:30.439563017 +0000 UTC m=+3164.684939717" watchObservedRunningTime="2026-07-28 21:17:30.440950019 +0000 UTC m=+3164.686326717"
Jul 28 21:17:38.206219 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:38.206185    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:17:41.433690 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:17:41.433652    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"
Jul 28 21:18:00.229265 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:00.229236    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-ktvgp_0a4b796a-f666-4783-bfbf-3b83ecf959c7/payload-processing/0.log"
Jul 28 21:18:05.403179 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.403142    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"]
Jul 28 21:18:05.406867 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.406849    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.409633 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.409608    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-d6ef24\"/\"openshift-service-ca.crt\""
Jul 28 21:18:05.409746 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.409632    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-d6ef24\"/\"kube-root-ca.crt\""
Jul 28 21:18:05.410549 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.410528    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-d6ef24\"/\"default-dockercfg-k6shr\""
Jul 28 21:18:05.410646 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.410596    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-d6ef24\"/\"ipp-route-d6ef24-kserve-self-signed-certs\""
Jul 28 21:18:05.419157 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.419134    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"]
Jul 28 21:18:05.494406 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.494364    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-dshm\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.494588 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.494413    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-home\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.494588 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.494467    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d7a8eb9-5557-4c62-95e2-e29403443f40-tls-certs\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.494588 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.494510    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vblbj\" (UniqueName: \"kubernetes.io/projected/8d7a8eb9-5557-4c62-95e2-e29403443f40-kube-api-access-vblbj\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.494588 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.494565    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-model-cache\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.494744 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.494594    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-tmp-dir\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.595160 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.595125    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-dshm\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.595160 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.595170    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-home\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.595434 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.595195    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d7a8eb9-5557-4c62-95e2-e29403443f40-tls-certs\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.595434 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.595402    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vblbj\" (UniqueName: \"kubernetes.io/projected/8d7a8eb9-5557-4c62-95e2-e29403443f40-kube-api-access-vblbj\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.595553 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.595489    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-model-cache\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.595553 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.595542    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-tmp-dir\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.595693 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.595666    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-home\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.596093 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.596065    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-model-cache\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.596188 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.596114    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-tmp-dir\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.597746 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.597701    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-dshm\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.598337 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.598318    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d7a8eb9-5557-4c62-95e2-e29403443f40-tls-certs\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.605828 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.605804    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vblbj\" (UniqueName: \"kubernetes.io/projected/8d7a8eb9-5557-4c62-95e2-e29403443f40-kube-api-access-vblbj\") pod \"ipp-route-d6ef24-kserve-547659776c-k28xz\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") " pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.716356 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.716260    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:05.858451 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:05.858418    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"]
Jul 28 21:18:05.860378 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:18:05.860348    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d7a8eb9_5557_4c62_95e2_e29403443f40.slice/crio-1535264e815b26c2fd88467f2392bbe8dc7165285f24e517d32ef0a0cdb6d2ad WatchSource:0}: Error finding container 1535264e815b26c2fd88467f2392bbe8dc7165285f24e517d32ef0a0cdb6d2ad: Status 404 returned error can't find the container with id 1535264e815b26c2fd88467f2392bbe8dc7165285f24e517d32ef0a0cdb6d2ad
Jul 28 21:18:06.617554 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:06.617516    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz" event={"ID":"8d7a8eb9-5557-4c62-95e2-e29403443f40","Type":"ContainerStarted","Data":"3660206ecae9ec3ed443e8c9599f0a52b0386d13b63df611b2fdc4068ace112e"}
Jul 28 21:18:06.617983 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:06.617561    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz" event={"ID":"8d7a8eb9-5557-4c62-95e2-e29403443f40","Type":"ContainerStarted","Data":"1535264e815b26c2fd88467f2392bbe8dc7165285f24e517d32ef0a0cdb6d2ad"}
Jul 28 21:18:06.635737 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:06.635686    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz" podStartSLOduration=1.6356666579999999 podStartE2EDuration="1.635666658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:18:06.634064213 +0000 UTC m=+3200.879440916" watchObservedRunningTime="2026-07-28 21:18:06.635666658 +0000 UTC m=+3200.881043405"
Jul 28 21:18:09.616814 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:09.616774    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:18:15.716722 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:15.716679    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:15.717202 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:15.716733    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:15.729484 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:15.729455    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:16.679943 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:16.679899    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:18:35.612900 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:35.612860    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:18:47.409389 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:47.409317    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp_d0781850-ac90-4ad5-8c62-0be429f9d9de/payload-processing/0.log"
Jul 28 21:18:47.541099 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:47.541072    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-ktvgp_0a4b796a-f666-4783-bfbf-3b83ecf959c7/payload-processing/0.log"
Jul 28 21:18:52.485977 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:52.485939    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"]
Jul 28 21:18:52.489813 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:52.489783    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"
Jul 28 21:18:52.492718 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:52.492693    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-8951c6\""
Jul 28 21:18:52.502175 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:52.502138    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"]
Jul 28 21:18:52.556675 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:52.556629    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vcwx\" (UniqueName: \"kubernetes.io/projected/b5b76d2d-eac8-4bf0-87f9-c202072c6dcc-kube-api-access-4vcwx\") pod \"payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx\" (UID: \"b5b76d2d-eac8-4bf0-87f9-c202072c6dcc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"
Jul 28 21:18:52.556844 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:52.556766    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5b76d2d-eac8-4bf0-87f9-c202072c6dcc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx\" (UID: \"b5b76d2d-eac8-4bf0-87f9-c202072c6dcc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"
Jul 28 21:18:52.658157 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:52.658117    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vcwx\" (UniqueName: \"kubernetes.io/projected/b5b76d2d-eac8-4bf0-87f9-c202072c6dcc-kube-api-access-4vcwx\") pod \"payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx\" (UID: \"b5b76d2d-eac8-4bf0-87f9-c202072c6dcc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"
Jul 28 21:18:52.658341 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:52.658194    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5b76d2d-eac8-4bf0-87f9-c202072c6dcc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx\" (UID: \"b5b76d2d-eac8-4bf0-87f9-c202072c6dcc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"
Jul 28 21:18:52.658829 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:52.658808    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5b76d2d-eac8-4bf0-87f9-c202072c6dcc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx\" (UID: \"b5b76d2d-eac8-4bf0-87f9-c202072c6dcc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"
Jul 28 21:18:52.667064 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:52.667040    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vcwx\" (UniqueName: \"kubernetes.io/projected/b5b76d2d-eac8-4bf0-87f9-c202072c6dcc-kube-api-access-4vcwx\") pod \"payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx\" (UID: \"b5b76d2d-eac8-4bf0-87f9-c202072c6dcc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"
Jul 28 21:18:52.801361 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:52.801259    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"
Jul 28 21:18:53.148714 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:53.148680    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"]
Jul 28 21:18:53.152106 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:18:53.152076    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b76d2d_eac8_4bf0_87f9_c202072c6dcc.slice/crio-3eafb352b725a831b21c246824f5159e7ee8d595e8c6d2c6d4c38ce98860bb88 WatchSource:0}: Error finding container 3eafb352b725a831b21c246824f5159e7ee8d595e8c6d2c6d4c38ce98860bb88: Status 404 returned error can't find the container with id 3eafb352b725a831b21c246824f5159e7ee8d595e8c6d2c6d4c38ce98860bb88
Jul 28 21:18:53.858895 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:53.858852    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx" event={"ID":"b5b76d2d-eac8-4bf0-87f9-c202072c6dcc","Type":"ContainerStarted","Data":"19bb546b0f1493eca75b8764006f9179f21f7d0f1b2ff9cbc9a21fed10513461"}
Jul 28 21:18:53.859345 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:53.858920    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx" event={"ID":"b5b76d2d-eac8-4bf0-87f9-c202072c6dcc","Type":"ContainerStarted","Data":"3eafb352b725a831b21c246824f5159e7ee8d595e8c6d2c6d4c38ce98860bb88"}
Jul 28 21:18:53.859345 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:53.858977    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"
Jul 28 21:18:53.877428 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:53.877377    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx" podStartSLOduration=1.87736241 podStartE2EDuration="1.87736241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:18:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:18:53.877124336 +0000 UTC m=+3248.122501039" watchObservedRunningTime="2026-07-28 21:18:53.87736241 +0000 UTC m=+3248.122739111"
Jul 28 21:18:56.009286 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:18:56.009251    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:19:04.865835 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:04.865796    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"
Jul 28 21:19:22.483691 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:22.483657    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"]
Jul 28 21:19:22.484484 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:22.483877    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx" podUID="b5b76d2d-eac8-4bf0-87f9-c202072c6dcc" containerName="payload-pre-processing" containerID="cri-o://19bb546b0f1493eca75b8764006f9179f21f7d0f1b2ff9cbc9a21fed10513461" gracePeriod=30
Jul 28 21:19:22.752970 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:22.752919    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"
Jul 28 21:19:22.863153 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:22.863118    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vcwx\" (UniqueName: \"kubernetes.io/projected/b5b76d2d-eac8-4bf0-87f9-c202072c6dcc-kube-api-access-4vcwx\") pod \"b5b76d2d-eac8-4bf0-87f9-c202072c6dcc\" (UID: \"b5b76d2d-eac8-4bf0-87f9-c202072c6dcc\") "
Jul 28 21:19:22.863322 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:22.863191    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5b76d2d-eac8-4bf0-87f9-c202072c6dcc-plugins-config-volume\") pod \"b5b76d2d-eac8-4bf0-87f9-c202072c6dcc\" (UID: \"b5b76d2d-eac8-4bf0-87f9-c202072c6dcc\") "
Jul 28 21:19:22.863572 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:22.863549    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5b76d2d-eac8-4bf0-87f9-c202072c6dcc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b5b76d2d-eac8-4bf0-87f9-c202072c6dcc" (UID: "b5b76d2d-eac8-4bf0-87f9-c202072c6dcc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:19:22.865227 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:22.865201    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5b76d2d-eac8-4bf0-87f9-c202072c6dcc-kube-api-access-4vcwx" (OuterVolumeSpecName: "kube-api-access-4vcwx") pod "b5b76d2d-eac8-4bf0-87f9-c202072c6dcc" (UID: "b5b76d2d-eac8-4bf0-87f9-c202072c6dcc"). InnerVolumeSpecName "kube-api-access-4vcwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:19:22.964544 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:22.964503    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vcwx\" (UniqueName: \"kubernetes.io/projected/b5b76d2d-eac8-4bf0-87f9-c202072c6dcc-kube-api-access-4vcwx\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:19:22.964544 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:22.964538    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5b76d2d-eac8-4bf0-87f9-c202072c6dcc-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:19:23.007131 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:23.007036    2555 generic.go:356] "Generic (PLEG): container finished" podID="b5b76d2d-eac8-4bf0-87f9-c202072c6dcc" containerID="19bb546b0f1493eca75b8764006f9179f21f7d0f1b2ff9cbc9a21fed10513461" exitCode=0
Jul 28 21:19:23.007131 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:23.007091    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"
Jul 28 21:19:23.007318 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:23.007123    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx" event={"ID":"b5b76d2d-eac8-4bf0-87f9-c202072c6dcc","Type":"ContainerDied","Data":"19bb546b0f1493eca75b8764006f9179f21f7d0f1b2ff9cbc9a21fed10513461"}
Jul 28 21:19:23.007318 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:23.007181    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx" event={"ID":"b5b76d2d-eac8-4bf0-87f9-c202072c6dcc","Type":"ContainerDied","Data":"3eafb352b725a831b21c246824f5159e7ee8d595e8c6d2c6d4c38ce98860bb88"}
Jul 28 21:19:23.007318 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:23.007205    2555 scope.go:117] "RemoveContainer" containerID="19bb546b0f1493eca75b8764006f9179f21f7d0f1b2ff9cbc9a21fed10513461"
Jul 28 21:19:23.021894 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:23.021872    2555 scope.go:117] "RemoveContainer" containerID="19bb546b0f1493eca75b8764006f9179f21f7d0f1b2ff9cbc9a21fed10513461"
Jul 28 21:19:23.022298 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:19:23.022272    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19bb546b0f1493eca75b8764006f9179f21f7d0f1b2ff9cbc9a21fed10513461\": container with ID starting with 19bb546b0f1493eca75b8764006f9179f21f7d0f1b2ff9cbc9a21fed10513461 not found: ID does not exist" containerID="19bb546b0f1493eca75b8764006f9179f21f7d0f1b2ff9cbc9a21fed10513461"
Jul 28 21:19:23.022405 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:23.022307    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19bb546b0f1493eca75b8764006f9179f21f7d0f1b2ff9cbc9a21fed10513461"} err="failed to get container status \"19bb546b0f1493eca75b8764006f9179f21f7d0f1b2ff9cbc9a21fed10513461\": rpc error: code = NotFound desc = could not find container \"19bb546b0f1493eca75b8764006f9179f21f7d0f1b2ff9cbc9a21fed10513461\": container with ID starting with 19bb546b0f1493eca75b8764006f9179f21f7d0f1b2ff9cbc9a21fed10513461 not found: ID does not exist"
Jul 28 21:19:23.036154 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:23.036122    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"]
Jul 28 21:19:23.042889 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:23.042862    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8951c6-584dc846f6-n6lgx"]
Jul 28 21:19:24.296025 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:24.295993    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5b76d2d-eac8-4bf0-87f9-c202072c6dcc" path="/var/lib/kubelet/pods/b5b76d2d-eac8-4bf0-87f9-c202072c6dcc/volumes"
Jul 28 21:19:27.206142 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:27.206109    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:19:46.507926 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:46.507894    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 21:19:46.515346 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:46.515318    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 21:19:49.424847 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:49.424470    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"]
Jul 28 21:19:49.424847 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:49.424722    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp" podUID="d0781850-ac90-4ad5-8c62-0be429f9d9de" containerName="payload-processing" containerID="cri-o://092af3310a57c1df0785a46b6ae753b813a1be1100ea0ecb909a21fbb2e361b5" gracePeriod=30
Jul 28 21:19:49.431052 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:49.431022    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"]
Jul 28 21:19:49.431279 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:49.431251    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6" podUID="53fc55c4-d712-4be8-a402-164e8dc346d1" containerName="payload-pre-processing" containerID="cri-o://de7055def77c924ce6ab88b3159edd6c89d5e33483c164da2ff79e72ef334672" gracePeriod=30
Jul 28 21:19:49.692675 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:49.692597    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"
Jul 28 21:19:49.740014 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:49.739976    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"
Jul 28 21:19:49.828965 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:49.828921    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm8cx\" (UniqueName: \"kubernetes.io/projected/d0781850-ac90-4ad5-8c62-0be429f9d9de-kube-api-access-qm8cx\") pod \"d0781850-ac90-4ad5-8c62-0be429f9d9de\" (UID: \"d0781850-ac90-4ad5-8c62-0be429f9d9de\") "
Jul 28 21:19:49.829157 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:49.829062    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0781850-ac90-4ad5-8c62-0be429f9d9de-plugins-config-volume\") pod \"d0781850-ac90-4ad5-8c62-0be429f9d9de\" (UID: \"d0781850-ac90-4ad5-8c62-0be429f9d9de\") "
Jul 28 21:19:49.829436 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:49.829410    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0781850-ac90-4ad5-8c62-0be429f9d9de-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d0781850-ac90-4ad5-8c62-0be429f9d9de" (UID: "d0781850-ac90-4ad5-8c62-0be429f9d9de"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:19:49.830977 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:49.830954    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0781850-ac90-4ad5-8c62-0be429f9d9de-kube-api-access-qm8cx" (OuterVolumeSpecName: "kube-api-access-qm8cx") pod "d0781850-ac90-4ad5-8c62-0be429f9d9de" (UID: "d0781850-ac90-4ad5-8c62-0be429f9d9de"). InnerVolumeSpecName "kube-api-access-qm8cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:19:49.930658 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:49.930620    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53fc55c4-d712-4be8-a402-164e8dc346d1-plugins-config-volume\") pod \"53fc55c4-d712-4be8-a402-164e8dc346d1\" (UID: \"53fc55c4-d712-4be8-a402-164e8dc346d1\") "
Jul 28 21:19:49.930857 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:49.930678    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnjjv\" (UniqueName: \"kubernetes.io/projected/53fc55c4-d712-4be8-a402-164e8dc346d1-kube-api-access-fnjjv\") pod \"53fc55c4-d712-4be8-a402-164e8dc346d1\" (UID: \"53fc55c4-d712-4be8-a402-164e8dc346d1\") "
Jul 28 21:19:49.930958 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:49.930887    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0781850-ac90-4ad5-8c62-0be429f9d9de-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:19:49.930958 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:49.930900    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm8cx\" (UniqueName: \"kubernetes.io/projected/d0781850-ac90-4ad5-8c62-0be429f9d9de-kube-api-access-qm8cx\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:19:49.931083 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:49.931005    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53fc55c4-d712-4be8-a402-164e8dc346d1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "53fc55c4-d712-4be8-a402-164e8dc346d1" (UID: "53fc55c4-d712-4be8-a402-164e8dc346d1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:19:49.932872 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:49.932840    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53fc55c4-d712-4be8-a402-164e8dc346d1-kube-api-access-fnjjv" (OuterVolumeSpecName: "kube-api-access-fnjjv") pod "53fc55c4-d712-4be8-a402-164e8dc346d1" (UID: "53fc55c4-d712-4be8-a402-164e8dc346d1"). InnerVolumeSpecName "kube-api-access-fnjjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:19:50.031461 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.031382    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53fc55c4-d712-4be8-a402-164e8dc346d1-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:19:50.031461 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.031412    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnjjv\" (UniqueName: \"kubernetes.io/projected/53fc55c4-d712-4be8-a402-164e8dc346d1-kube-api-access-fnjjv\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:19:50.148961 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.148899    2555 generic.go:356] "Generic (PLEG): container finished" podID="d0781850-ac90-4ad5-8c62-0be429f9d9de" containerID="092af3310a57c1df0785a46b6ae753b813a1be1100ea0ecb909a21fbb2e361b5" exitCode=0
Jul 28 21:19:50.149162 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.148972    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"
Jul 28 21:19:50.149162 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.148986    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp" event={"ID":"d0781850-ac90-4ad5-8c62-0be429f9d9de","Type":"ContainerDied","Data":"092af3310a57c1df0785a46b6ae753b813a1be1100ea0ecb909a21fbb2e361b5"}
Jul 28 21:19:50.149162 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.149080    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp" event={"ID":"d0781850-ac90-4ad5-8c62-0be429f9d9de","Type":"ContainerDied","Data":"6a0cfb6543c149f289628c356755c1a78d9d3dbceb9aaacf53a55f0776e20e53"}
Jul 28 21:19:50.149162 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.149112    2555 scope.go:117] "RemoveContainer" containerID="092af3310a57c1df0785a46b6ae753b813a1be1100ea0ecb909a21fbb2e361b5"
Jul 28 21:19:50.150430 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.150406    2555 generic.go:356] "Generic (PLEG): container finished" podID="53fc55c4-d712-4be8-a402-164e8dc346d1" containerID="de7055def77c924ce6ab88b3159edd6c89d5e33483c164da2ff79e72ef334672" exitCode=0
Jul 28 21:19:50.150523 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.150446    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"
Jul 28 21:19:50.150523 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.150489    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6" event={"ID":"53fc55c4-d712-4be8-a402-164e8dc346d1","Type":"ContainerDied","Data":"de7055def77c924ce6ab88b3159edd6c89d5e33483c164da2ff79e72ef334672"}
Jul 28 21:19:50.150604 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.150528    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6" event={"ID":"53fc55c4-d712-4be8-a402-164e8dc346d1","Type":"ContainerDied","Data":"66fed909628ab52c7c3411761e7657582d04b398d4c9122b9f8f3494253ff743"}
Jul 28 21:19:50.159873 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.159847    2555 scope.go:117] "RemoveContainer" containerID="092af3310a57c1df0785a46b6ae753b813a1be1100ea0ecb909a21fbb2e361b5"
Jul 28 21:19:50.160180 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:19:50.160159    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"092af3310a57c1df0785a46b6ae753b813a1be1100ea0ecb909a21fbb2e361b5\": container with ID starting with 092af3310a57c1df0785a46b6ae753b813a1be1100ea0ecb909a21fbb2e361b5 not found: ID does not exist" containerID="092af3310a57c1df0785a46b6ae753b813a1be1100ea0ecb909a21fbb2e361b5"
Jul 28 21:19:50.160275 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.160187    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"092af3310a57c1df0785a46b6ae753b813a1be1100ea0ecb909a21fbb2e361b5"} err="failed to get container status \"092af3310a57c1df0785a46b6ae753b813a1be1100ea0ecb909a21fbb2e361b5\": rpc error: code = NotFound desc = could not find container \"092af3310a57c1df0785a46b6ae753b813a1be1100ea0ecb909a21fbb2e361b5\": container with ID starting with 092af3310a57c1df0785a46b6ae753b813a1be1100ea0ecb909a21fbb2e361b5 not found: ID does not exist"
Jul 28 21:19:50.160275 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.160206    2555 scope.go:117] "RemoveContainer" containerID="de7055def77c924ce6ab88b3159edd6c89d5e33483c164da2ff79e72ef334672"
Jul 28 21:19:50.170219 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.170197    2555 scope.go:117] "RemoveContainer" containerID="de7055def77c924ce6ab88b3159edd6c89d5e33483c164da2ff79e72ef334672"
Jul 28 21:19:50.170586 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:19:50.170562    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de7055def77c924ce6ab88b3159edd6c89d5e33483c164da2ff79e72ef334672\": container with ID starting with de7055def77c924ce6ab88b3159edd6c89d5e33483c164da2ff79e72ef334672 not found: ID does not exist" containerID="de7055def77c924ce6ab88b3159edd6c89d5e33483c164da2ff79e72ef334672"
Jul 28 21:19:50.170690 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.170591    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7055def77c924ce6ab88b3159edd6c89d5e33483c164da2ff79e72ef334672"} err="failed to get container status \"de7055def77c924ce6ab88b3159edd6c89d5e33483c164da2ff79e72ef334672\": rpc error: code = NotFound desc = could not find container \"de7055def77c924ce6ab88b3159edd6c89d5e33483c164da2ff79e72ef334672\": container with ID starting with de7055def77c924ce6ab88b3159edd6c89d5e33483c164da2ff79e72ef334672 not found: ID does not exist"
Jul 28 21:19:50.199101 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.199070    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"]
Jul 28 21:19:50.203444 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.203418    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d6ef24-cb545c56-8lpp6"]
Jul 28 21:19:50.215721 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.215687    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"]
Jul 28 21:19:50.218431 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.218408    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d6ef24-77d7c96f48-9zbqp"]
Jul 28 21:19:50.296750 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.296666    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53fc55c4-d712-4be8-a402-164e8dc346d1" path="/var/lib/kubelet/pods/53fc55c4-d712-4be8-a402-164e8dc346d1/volumes"
Jul 28 21:19:50.297100 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.297085    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0781850-ac90-4ad5-8c62-0be429f9d9de" path="/var/lib/kubelet/pods/d0781850-ac90-4ad5-8c62-0be429f9d9de/volumes"
Jul 28 21:19:50.608190 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:50.608157    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:19:55.051281 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:19:55.051245    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"]
Jul 28 21:20:02.105814 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:02.105779    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:20:10.070976 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.070837    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz" podUID="8d7a8eb9-5557-4c62-95e2-e29403443f40" containerName="main" containerID="cri-o://3660206ecae9ec3ed443e8c9599f0a52b0386d13b63df611b2fdc4068ace112e" gracePeriod=45
Jul 28 21:20:10.250331 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.250297    2555 generic.go:356] "Generic (PLEG): container finished" podID="8d7a8eb9-5557-4c62-95e2-e29403443f40" containerID="3660206ecae9ec3ed443e8c9599f0a52b0386d13b63df611b2fdc4068ace112e" exitCode=0
Jul 28 21:20:10.250331 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.250324    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz" event={"ID":"8d7a8eb9-5557-4c62-95e2-e29403443f40","Type":"ContainerDied","Data":"3660206ecae9ec3ed443e8c9599f0a52b0386d13b63df611b2fdc4068ace112e"}
Jul 28 21:20:10.329278 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.329213    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:20:10.418203 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.418169    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-dshm\") pod \"8d7a8eb9-5557-4c62-95e2-e29403443f40\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") "
Jul 28 21:20:10.418398 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.418224    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-model-cache\") pod \"8d7a8eb9-5557-4c62-95e2-e29403443f40\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") "
Jul 28 21:20:10.418398 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.418248    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-tmp-dir\") pod \"8d7a8eb9-5557-4c62-95e2-e29403443f40\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") "
Jul 28 21:20:10.418398 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.418338    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vblbj\" (UniqueName: \"kubernetes.io/projected/8d7a8eb9-5557-4c62-95e2-e29403443f40-kube-api-access-vblbj\") pod \"8d7a8eb9-5557-4c62-95e2-e29403443f40\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") "
Jul 28 21:20:10.418398 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.418361    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d7a8eb9-5557-4c62-95e2-e29403443f40-tls-certs\") pod \"8d7a8eb9-5557-4c62-95e2-e29403443f40\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") "
Jul 28 21:20:10.418398 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.418382    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-home\") pod \"8d7a8eb9-5557-4c62-95e2-e29403443f40\" (UID: \"8d7a8eb9-5557-4c62-95e2-e29403443f40\") "
Jul 28 21:20:10.418671 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.418580    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-model-cache" (OuterVolumeSpecName: "model-cache") pod "8d7a8eb9-5557-4c62-95e2-e29403443f40" (UID: "8d7a8eb9-5557-4c62-95e2-e29403443f40"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:20:10.418671 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.418609    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8d7a8eb9-5557-4c62-95e2-e29403443f40" (UID: "8d7a8eb9-5557-4c62-95e2-e29403443f40"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:20:10.418774 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.418688    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-home" (OuterVolumeSpecName: "home") pod "8d7a8eb9-5557-4c62-95e2-e29403443f40" (UID: "8d7a8eb9-5557-4c62-95e2-e29403443f40"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:20:10.418774 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.418759    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-model-cache\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:20:10.418864 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.418779    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-tmp-dir\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:20:10.420491 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.420464    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-dshm" (OuterVolumeSpecName: "dshm") pod "8d7a8eb9-5557-4c62-95e2-e29403443f40" (UID: "8d7a8eb9-5557-4c62-95e2-e29403443f40"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:20:10.420609 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.420514    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d7a8eb9-5557-4c62-95e2-e29403443f40-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8d7a8eb9-5557-4c62-95e2-e29403443f40" (UID: "8d7a8eb9-5557-4c62-95e2-e29403443f40"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:20:10.420609 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.420552    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d7a8eb9-5557-4c62-95e2-e29403443f40-kube-api-access-vblbj" (OuterVolumeSpecName: "kube-api-access-vblbj") pod "8d7a8eb9-5557-4c62-95e2-e29403443f40" (UID: "8d7a8eb9-5557-4c62-95e2-e29403443f40"). InnerVolumeSpecName "kube-api-access-vblbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:20:10.519998 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.519959    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vblbj\" (UniqueName: \"kubernetes.io/projected/8d7a8eb9-5557-4c62-95e2-e29403443f40-kube-api-access-vblbj\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:20:10.519998 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.519997    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d7a8eb9-5557-4c62-95e2-e29403443f40-tls-certs\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:20:10.520193 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.520009    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-home\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:20:10.520193 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:10.520017    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d7a8eb9-5557-4c62-95e2-e29403443f40-dshm\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:20:11.256699 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:11.256666    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"
Jul 28 21:20:11.257167 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:11.256666    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz" event={"ID":"8d7a8eb9-5557-4c62-95e2-e29403443f40","Type":"ContainerDied","Data":"1535264e815b26c2fd88467f2392bbe8dc7165285f24e517d32ef0a0cdb6d2ad"}
Jul 28 21:20:11.257167 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:11.256796    2555 scope.go:117] "RemoveContainer" containerID="3660206ecae9ec3ed443e8c9599f0a52b0386d13b63df611b2fdc4068ace112e"
Jul 28 21:20:11.282080 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:11.282054    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"]
Jul 28 21:20:11.286209 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:11.286185    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-d6ef24/ipp-route-d6ef24-kserve-547659776c-k28xz"]
Jul 28 21:20:12.295469 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:20:12.295436    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d7a8eb9-5557-4c62-95e2-e29403443f40" path="/var/lib/kubelet/pods/8d7a8eb9-5557-4c62-95e2-e29403443f40/volumes"
Jul 28 21:21:05.327416 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:05.327373    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"]
Jul 28 21:21:05.328025 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:05.327571    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq" podUID="fbaa8510-65dc-4822-9d78-067ffb13c6ee" containerName="payload-pre-processing" containerID="cri-o://660cbd9724a94de81d79ba9767dbe4c9555765448500cf997ea310c5fa8205b5" gracePeriod=30
Jul 28 21:21:05.523752 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:05.523720    2555 generic.go:356] "Generic (PLEG): container finished" podID="fbaa8510-65dc-4822-9d78-067ffb13c6ee" containerID="660cbd9724a94de81d79ba9767dbe4c9555765448500cf997ea310c5fa8205b5" exitCode=0
Jul 28 21:21:05.523974 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:05.523760    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq" event={"ID":"fbaa8510-65dc-4822-9d78-067ffb13c6ee","Type":"ContainerDied","Data":"660cbd9724a94de81d79ba9767dbe4c9555765448500cf997ea310c5fa8205b5"}
Jul 28 21:21:05.592258 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:05.592185    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"
Jul 28 21:21:05.743051 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:05.742989    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbaa8510-65dc-4822-9d78-067ffb13c6ee-plugins-config-volume\") pod \"fbaa8510-65dc-4822-9d78-067ffb13c6ee\" (UID: \"fbaa8510-65dc-4822-9d78-067ffb13c6ee\") "
Jul 28 21:21:05.743252 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:05.743091    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k78k\" (UniqueName: \"kubernetes.io/projected/fbaa8510-65dc-4822-9d78-067ffb13c6ee-kube-api-access-6k78k\") pod \"fbaa8510-65dc-4822-9d78-067ffb13c6ee\" (UID: \"fbaa8510-65dc-4822-9d78-067ffb13c6ee\") "
Jul 28 21:21:05.743429 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:05.743404    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbaa8510-65dc-4822-9d78-067ffb13c6ee-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fbaa8510-65dc-4822-9d78-067ffb13c6ee" (UID: "fbaa8510-65dc-4822-9d78-067ffb13c6ee"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:21:05.745181 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:05.745155    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbaa8510-65dc-4822-9d78-067ffb13c6ee-kube-api-access-6k78k" (OuterVolumeSpecName: "kube-api-access-6k78k") pod "fbaa8510-65dc-4822-9d78-067ffb13c6ee" (UID: "fbaa8510-65dc-4822-9d78-067ffb13c6ee"). InnerVolumeSpecName "kube-api-access-6k78k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:21:05.844845 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:05.844736    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fbaa8510-65dc-4822-9d78-067ffb13c6ee-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:05.844845 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:05.844786    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k78k\" (UniqueName: \"kubernetes.io/projected/fbaa8510-65dc-4822-9d78-067ffb13c6ee-kube-api-access-6k78k\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:06.533423 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:06.533394    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"
Jul 28 21:21:06.533914 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:06.533392    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq" event={"ID":"fbaa8510-65dc-4822-9d78-067ffb13c6ee","Type":"ContainerDied","Data":"95dd0d090581bd78a54b145cfb4ac4ed22e13649c2cc8f7f1d6dcd2d5a875eab"}
Jul 28 21:21:06.533914 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:06.533538    2555 scope.go:117] "RemoveContainer" containerID="660cbd9724a94de81d79ba9767dbe4c9555765448500cf997ea310c5fa8205b5"
Jul 28 21:21:06.559196 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:06.559094    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"]
Jul 28 21:21:06.564477 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:06.564447    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-590ada-59688b8d7b-x9psq"]
Jul 28 21:21:08.295687 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:08.295650    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbaa8510-65dc-4822-9d78-067ffb13c6ee" path="/var/lib/kubelet/pods/fbaa8510-65dc-4822-9d78-067ffb13c6ee/volumes"
Jul 28 21:21:08.640286 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:08.640245    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:21:24.230334 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.230297    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"]
Jul 28 21:21:24.230869 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.230502    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j" podUID="c000d44a-5737-41cd-9114-ad6088ac8b6f" containerName="payload-pre-processing" containerID="cri-o://06318b2145d2bbeddc859a99d830652a215b3e7d85e8ea368141331cdb130d3a" gracePeriod=30
Jul 28 21:21:24.506458 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.506432    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"
Jul 28 21:21:24.618996 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.618923    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c000d44a-5737-41cd-9114-ad6088ac8b6f-plugins-config-volume\") pod \"c000d44a-5737-41cd-9114-ad6088ac8b6f\" (UID: \"c000d44a-5737-41cd-9114-ad6088ac8b6f\") "
Jul 28 21:21:24.619170 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.619036    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bmpr\" (UniqueName: \"kubernetes.io/projected/c000d44a-5737-41cd-9114-ad6088ac8b6f-kube-api-access-6bmpr\") pod \"c000d44a-5737-41cd-9114-ad6088ac8b6f\" (UID: \"c000d44a-5737-41cd-9114-ad6088ac8b6f\") "
Jul 28 21:21:24.619383 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.619348    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c000d44a-5737-41cd-9114-ad6088ac8b6f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c000d44a-5737-41cd-9114-ad6088ac8b6f" (UID: "c000d44a-5737-41cd-9114-ad6088ac8b6f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:21:24.621436 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.621412    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c000d44a-5737-41cd-9114-ad6088ac8b6f-kube-api-access-6bmpr" (OuterVolumeSpecName: "kube-api-access-6bmpr") pod "c000d44a-5737-41cd-9114-ad6088ac8b6f" (UID: "c000d44a-5737-41cd-9114-ad6088ac8b6f"). InnerVolumeSpecName "kube-api-access-6bmpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:21:24.625111 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.625084    2555 generic.go:356] "Generic (PLEG): container finished" podID="c000d44a-5737-41cd-9114-ad6088ac8b6f" containerID="06318b2145d2bbeddc859a99d830652a215b3e7d85e8ea368141331cdb130d3a" exitCode=0
Jul 28 21:21:24.625241 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.625120    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j" event={"ID":"c000d44a-5737-41cd-9114-ad6088ac8b6f","Type":"ContainerDied","Data":"06318b2145d2bbeddc859a99d830652a215b3e7d85e8ea368141331cdb130d3a"}
Jul 28 21:21:24.625241 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.625125    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"
Jul 28 21:21:24.625241 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.625167    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j" event={"ID":"c000d44a-5737-41cd-9114-ad6088ac8b6f","Type":"ContainerDied","Data":"aa73f901166709b302bd1b5fbb358fe80700cd7eb512c684bdbf5ea1ac582c7c"}
Jul 28 21:21:24.625241 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.625190    2555 scope.go:117] "RemoveContainer" containerID="06318b2145d2bbeddc859a99d830652a215b3e7d85e8ea368141331cdb130d3a"
Jul 28 21:21:24.635023 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.635004    2555 scope.go:117] "RemoveContainer" containerID="06318b2145d2bbeddc859a99d830652a215b3e7d85e8ea368141331cdb130d3a"
Jul 28 21:21:24.635277 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:21:24.635254    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06318b2145d2bbeddc859a99d830652a215b3e7d85e8ea368141331cdb130d3a\": container with ID starting with 06318b2145d2bbeddc859a99d830652a215b3e7d85e8ea368141331cdb130d3a not found: ID does not exist" containerID="06318b2145d2bbeddc859a99d830652a215b3e7d85e8ea368141331cdb130d3a"
Jul 28 21:21:24.635346 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.635291    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06318b2145d2bbeddc859a99d830652a215b3e7d85e8ea368141331cdb130d3a"} err="failed to get container status \"06318b2145d2bbeddc859a99d830652a215b3e7d85e8ea368141331cdb130d3a\": rpc error: code = NotFound desc = could not find container \"06318b2145d2bbeddc859a99d830652a215b3e7d85e8ea368141331cdb130d3a\": container with ID starting with 06318b2145d2bbeddc859a99d830652a215b3e7d85e8ea368141331cdb130d3a not found: ID does not exist"
Jul 28 21:21:24.651231 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.651202    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"]
Jul 28 21:21:24.654432 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.654401    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-96b3c5-78d5b8cd4d-shw4j"]
Jul 28 21:21:24.720466 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.720428    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c000d44a-5737-41cd-9114-ad6088ac8b6f-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:24.720466 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:24.720458    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bmpr\" (UniqueName: \"kubernetes.io/projected/c000d44a-5737-41cd-9114-ad6088ac8b6f-kube-api-access-6bmpr\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:26.295406 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:26.295364    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c000d44a-5737-41cd-9114-ad6088ac8b6f" path="/var/lib/kubelet/pods/c000d44a-5737-41cd-9114-ad6088ac8b6f/volumes"
Jul 28 21:21:27.228338 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:27.228305    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:21:31.877761 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:31.877723    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"]
Jul 28 21:21:31.878221 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:31.877972    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw" podUID="6bb9f589-5f45-4bc1-8756-6eb30253c3b3" containerName="istio-proxy" containerID="cri-o://a29d0f94392da726ea1f07767dc96767f063021beda38316ebb1fea87367deb5" gracePeriod=30
Jul 28 21:21:37.132017 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.131982    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:21:37.236951 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.236850    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-token\") pod \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") "
Jul 28 21:21:37.236951 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.236907    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-workload-certs\") pod \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") "
Jul 28 21:21:37.237191 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.237056    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-credential-socket\") pod \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") "
Jul 28 21:21:37.237191 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.237086    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-workload-socket\") pod \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") "
Jul 28 21:21:37.237191 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.237131    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istiod-ca-cert\") pod \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") "
Jul 28 21:21:37.237191 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.237155    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-envoy\") pod \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") "
Jul 28 21:21:37.237406 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.237215    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-data\") pod \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") "
Jul 28 21:21:37.237406 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.237242    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-podinfo\") pod \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") "
Jul 28 21:21:37.237406 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.237274    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfgkt\" (UniqueName: \"kubernetes.io/projected/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-kube-api-access-wfgkt\") pod \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\" (UID: \"6bb9f589-5f45-4bc1-8756-6eb30253c3b3\") "
Jul 28 21:21:37.237406 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.237329    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6bb9f589-5f45-4bc1-8756-6eb30253c3b3" (UID: "6bb9f589-5f45-4bc1-8756-6eb30253c3b3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:21:37.237406 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.237388    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6bb9f589-5f45-4bc1-8756-6eb30253c3b3" (UID: "6bb9f589-5f45-4bc1-8756-6eb30253c3b3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:21:37.237912 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.237678    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6bb9f589-5f45-4bc1-8756-6eb30253c3b3" (UID: "6bb9f589-5f45-4bc1-8756-6eb30253c3b3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:21:37.237912 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.237730    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6bb9f589-5f45-4bc1-8756-6eb30253c3b3" (UID: "6bb9f589-5f45-4bc1-8756-6eb30253c3b3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:21:37.237912 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.237816    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-credential-socket\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:37.237912 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.237841    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-workload-socket\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:37.238612 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.238570    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-data" (OuterVolumeSpecName: "istio-data") pod "6bb9f589-5f45-4bc1-8756-6eb30253c3b3" (UID: "6bb9f589-5f45-4bc1-8756-6eb30253c3b3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:21:37.240670 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.240646    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-token" (OuterVolumeSpecName: "istio-token") pod "6bb9f589-5f45-4bc1-8756-6eb30253c3b3" (UID: "6bb9f589-5f45-4bc1-8756-6eb30253c3b3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:21:37.241326 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.240977    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-kube-api-access-wfgkt" (OuterVolumeSpecName: "kube-api-access-wfgkt") pod "6bb9f589-5f45-4bc1-8756-6eb30253c3b3" (UID: "6bb9f589-5f45-4bc1-8756-6eb30253c3b3"). InnerVolumeSpecName "kube-api-access-wfgkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:21:37.241326 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.241118    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6bb9f589-5f45-4bc1-8756-6eb30253c3b3" (UID: "6bb9f589-5f45-4bc1-8756-6eb30253c3b3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:21:37.241326 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.241203    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6bb9f589-5f45-4bc1-8756-6eb30253c3b3" (UID: "6bb9f589-5f45-4bc1-8756-6eb30253c3b3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:21:37.244369 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.244344    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"]
Jul 28 21:21:37.244635 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.244589    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b" podUID="a9ce6bc0-a3af-4151-a91b-7bec9f6cf051" containerName="payload-processing" containerID="cri-o://6af7d7cb6cb16e672ad932c6fd90dc4f75a435560b631571302c0161a5b67a61" gracePeriod=30
Jul 28 21:21:37.254715 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.254687    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"]
Jul 28 21:21:37.254962 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.254912    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4" podUID="c655df5e-c50e-4945-a301-6a086b14dce4" containerName="payload-pre-processing" containerID="cri-o://495609441e9a8c7bddc322e87ee42804dc93a111b907957fc0ce94178ade5e48" gracePeriod=30
Jul 28 21:21:37.339324 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.339289    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istiod-ca-cert\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:37.339324 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.339317    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-envoy\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:37.339324 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.339326    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-data\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:37.339560 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.339334    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-podinfo\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:37.339560 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.339343    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfgkt\" (UniqueName: \"kubernetes.io/projected/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-kube-api-access-wfgkt\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:37.339560 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.339353    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-istio-token\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:37.339560 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.339361    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bb9f589-5f45-4bc1-8756-6eb30253c3b3-workload-certs\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:37.513889 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.513862    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"
Jul 28 21:21:37.542454 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.542420    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"
Jul 28 21:21:37.641254 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.641212    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c655df5e-c50e-4945-a301-6a086b14dce4-plugins-config-volume\") pod \"c655df5e-c50e-4945-a301-6a086b14dce4\" (UID: \"c655df5e-c50e-4945-a301-6a086b14dce4\") "
Jul 28 21:21:37.641254 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.641260    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtdjv\" (UniqueName: \"kubernetes.io/projected/a9ce6bc0-a3af-4151-a91b-7bec9f6cf051-kube-api-access-gtdjv\") pod \"a9ce6bc0-a3af-4151-a91b-7bec9f6cf051\" (UID: \"a9ce6bc0-a3af-4151-a91b-7bec9f6cf051\") "
Jul 28 21:21:37.641472 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.641281    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm9q7\" (UniqueName: \"kubernetes.io/projected/c655df5e-c50e-4945-a301-6a086b14dce4-kube-api-access-bm9q7\") pod \"c655df5e-c50e-4945-a301-6a086b14dce4\" (UID: \"c655df5e-c50e-4945-a301-6a086b14dce4\") "
Jul 28 21:21:37.641472 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.641334    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9ce6bc0-a3af-4151-a91b-7bec9f6cf051-plugins-config-volume\") pod \"a9ce6bc0-a3af-4151-a91b-7bec9f6cf051\" (UID: \"a9ce6bc0-a3af-4151-a91b-7bec9f6cf051\") "
Jul 28 21:21:37.641742 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.641712    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c655df5e-c50e-4945-a301-6a086b14dce4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c655df5e-c50e-4945-a301-6a086b14dce4" (UID: "c655df5e-c50e-4945-a301-6a086b14dce4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:21:37.641742 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.641729    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9ce6bc0-a3af-4151-a91b-7bec9f6cf051-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a9ce6bc0-a3af-4151-a91b-7bec9f6cf051" (UID: "a9ce6bc0-a3af-4151-a91b-7bec9f6cf051"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:21:37.643379 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.643361    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9ce6bc0-a3af-4151-a91b-7bec9f6cf051-kube-api-access-gtdjv" (OuterVolumeSpecName: "kube-api-access-gtdjv") pod "a9ce6bc0-a3af-4151-a91b-7bec9f6cf051" (UID: "a9ce6bc0-a3af-4151-a91b-7bec9f6cf051"). InnerVolumeSpecName "kube-api-access-gtdjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:21:37.643442 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.643415    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c655df5e-c50e-4945-a301-6a086b14dce4-kube-api-access-bm9q7" (OuterVolumeSpecName: "kube-api-access-bm9q7") pod "c655df5e-c50e-4945-a301-6a086b14dce4" (UID: "c655df5e-c50e-4945-a301-6a086b14dce4"). InnerVolumeSpecName "kube-api-access-bm9q7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:21:37.690768 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.690724    2555 generic.go:356] "Generic (PLEG): container finished" podID="a9ce6bc0-a3af-4151-a91b-7bec9f6cf051" containerID="6af7d7cb6cb16e672ad932c6fd90dc4f75a435560b631571302c0161a5b67a61" exitCode=0
Jul 28 21:21:37.690768 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.690765    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"
Jul 28 21:21:37.691069 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.690820    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b" event={"ID":"a9ce6bc0-a3af-4151-a91b-7bec9f6cf051","Type":"ContainerDied","Data":"6af7d7cb6cb16e672ad932c6fd90dc4f75a435560b631571302c0161a5b67a61"}
Jul 28 21:21:37.691069 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.690873    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b" event={"ID":"a9ce6bc0-a3af-4151-a91b-7bec9f6cf051","Type":"ContainerDied","Data":"970e5524a127236e64ed2efdbb7d9914d2f8128344917a8aa2e364fe4b53e890"}
Jul 28 21:21:37.691069 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.690897    2555 scope.go:117] "RemoveContainer" containerID="6af7d7cb6cb16e672ad932c6fd90dc4f75a435560b631571302c0161a5b67a61"
Jul 28 21:21:37.692202 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.692184    2555 generic.go:356] "Generic (PLEG): container finished" podID="c655df5e-c50e-4945-a301-6a086b14dce4" containerID="495609441e9a8c7bddc322e87ee42804dc93a111b907957fc0ce94178ade5e48" exitCode=0
Jul 28 21:21:37.692299 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.692228    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"
Jul 28 21:21:37.692299 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.692287    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4" event={"ID":"c655df5e-c50e-4945-a301-6a086b14dce4","Type":"ContainerDied","Data":"495609441e9a8c7bddc322e87ee42804dc93a111b907957fc0ce94178ade5e48"}
Jul 28 21:21:37.692417 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.692339    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4" event={"ID":"c655df5e-c50e-4945-a301-6a086b14dce4","Type":"ContainerDied","Data":"582b1bae3db826e1f10736c9046b006f43d55e4265f56e0030a5abdeb6138874"}
Jul 28 21:21:37.694089 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.694062    2555 generic.go:356] "Generic (PLEG): container finished" podID="6bb9f589-5f45-4bc1-8756-6eb30253c3b3" containerID="a29d0f94392da726ea1f07767dc96767f063021beda38316ebb1fea87367deb5" exitCode=0
Jul 28 21:21:37.694226 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.694096    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw" event={"ID":"6bb9f589-5f45-4bc1-8756-6eb30253c3b3","Type":"ContainerDied","Data":"a29d0f94392da726ea1f07767dc96767f063021beda38316ebb1fea87367deb5"}
Jul 28 21:21:37.694226 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.694126    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw" event={"ID":"6bb9f589-5f45-4bc1-8756-6eb30253c3b3","Type":"ContainerDied","Data":"38798f865a07d6665f909473daa0277615637cd2414780e8b385f1e49b33c1ed"}
Jul 28 21:21:37.694226 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.694126    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"
Jul 28 21:21:37.701010 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.700985    2555 scope.go:117] "RemoveContainer" containerID="6af7d7cb6cb16e672ad932c6fd90dc4f75a435560b631571302c0161a5b67a61"
Jul 28 21:21:37.701296 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:21:37.701274    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6af7d7cb6cb16e672ad932c6fd90dc4f75a435560b631571302c0161a5b67a61\": container with ID starting with 6af7d7cb6cb16e672ad932c6fd90dc4f75a435560b631571302c0161a5b67a61 not found: ID does not exist" containerID="6af7d7cb6cb16e672ad932c6fd90dc4f75a435560b631571302c0161a5b67a61"
Jul 28 21:21:37.701378 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.701310    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6af7d7cb6cb16e672ad932c6fd90dc4f75a435560b631571302c0161a5b67a61"} err="failed to get container status \"6af7d7cb6cb16e672ad932c6fd90dc4f75a435560b631571302c0161a5b67a61\": rpc error: code = NotFound desc = could not find container \"6af7d7cb6cb16e672ad932c6fd90dc4f75a435560b631571302c0161a5b67a61\": container with ID starting with 6af7d7cb6cb16e672ad932c6fd90dc4f75a435560b631571302c0161a5b67a61 not found: ID does not exist"
Jul 28 21:21:37.701378 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.701333    2555 scope.go:117] "RemoveContainer" containerID="495609441e9a8c7bddc322e87ee42804dc93a111b907957fc0ce94178ade5e48"
Jul 28 21:21:37.710365 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.710346    2555 scope.go:117] "RemoveContainer" containerID="495609441e9a8c7bddc322e87ee42804dc93a111b907957fc0ce94178ade5e48"
Jul 28 21:21:37.710616 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:21:37.710595    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"495609441e9a8c7bddc322e87ee42804dc93a111b907957fc0ce94178ade5e48\": container with ID starting with 495609441e9a8c7bddc322e87ee42804dc93a111b907957fc0ce94178ade5e48 not found: ID does not exist" containerID="495609441e9a8c7bddc322e87ee42804dc93a111b907957fc0ce94178ade5e48"
Jul 28 21:21:37.710668 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.710623    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"495609441e9a8c7bddc322e87ee42804dc93a111b907957fc0ce94178ade5e48"} err="failed to get container status \"495609441e9a8c7bddc322e87ee42804dc93a111b907957fc0ce94178ade5e48\": rpc error: code = NotFound desc = could not find container \"495609441e9a8c7bddc322e87ee42804dc93a111b907957fc0ce94178ade5e48\": container with ID starting with 495609441e9a8c7bddc322e87ee42804dc93a111b907957fc0ce94178ade5e48 not found: ID does not exist"
Jul 28 21:21:37.710668 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.710641    2555 scope.go:117] "RemoveContainer" containerID="a29d0f94392da726ea1f07767dc96767f063021beda38316ebb1fea87367deb5"
Jul 28 21:21:37.718904 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.718885    2555 scope.go:117] "RemoveContainer" containerID="6e9e0d91e619c347b8652fadbbad105cdd5d00633cc499026f0cc1052880d955"
Jul 28 21:21:37.726468 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.726448    2555 scope.go:117] "RemoveContainer" containerID="a29d0f94392da726ea1f07767dc96767f063021beda38316ebb1fea87367deb5"
Jul 28 21:21:37.726737 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:21:37.726718    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a29d0f94392da726ea1f07767dc96767f063021beda38316ebb1fea87367deb5\": container with ID starting with a29d0f94392da726ea1f07767dc96767f063021beda38316ebb1fea87367deb5 not found: ID does not exist" containerID="a29d0f94392da726ea1f07767dc96767f063021beda38316ebb1fea87367deb5"
Jul 28 21:21:37.726791 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.726743    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a29d0f94392da726ea1f07767dc96767f063021beda38316ebb1fea87367deb5"} err="failed to get container status \"a29d0f94392da726ea1f07767dc96767f063021beda38316ebb1fea87367deb5\": rpc error: code = NotFound desc = could not find container \"a29d0f94392da726ea1f07767dc96767f063021beda38316ebb1fea87367deb5\": container with ID starting with a29d0f94392da726ea1f07767dc96767f063021beda38316ebb1fea87367deb5 not found: ID does not exist"
Jul 28 21:21:37.726791 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.726762    2555 scope.go:117] "RemoveContainer" containerID="6e9e0d91e619c347b8652fadbbad105cdd5d00633cc499026f0cc1052880d955"
Jul 28 21:21:37.727076 ip-10-0-137-26 kubenswrapper[2555]: E0728 21:21:37.727052    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e9e0d91e619c347b8652fadbbad105cdd5d00633cc499026f0cc1052880d955\": container with ID starting with 6e9e0d91e619c347b8652fadbbad105cdd5d00633cc499026f0cc1052880d955 not found: ID does not exist" containerID="6e9e0d91e619c347b8652fadbbad105cdd5d00633cc499026f0cc1052880d955"
Jul 28 21:21:37.727155 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.727084    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e9e0d91e619c347b8652fadbbad105cdd5d00633cc499026f0cc1052880d955"} err="failed to get container status \"6e9e0d91e619c347b8652fadbbad105cdd5d00633cc499026f0cc1052880d955\": rpc error: code = NotFound desc = could not find container \"6e9e0d91e619c347b8652fadbbad105cdd5d00633cc499026f0cc1052880d955\": container with ID starting with 6e9e0d91e619c347b8652fadbbad105cdd5d00633cc499026f0cc1052880d955 not found: ID does not exist"
Jul 28 21:21:37.729378 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.729356    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"]
Jul 28 21:21:37.731537 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.731517    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-4e7a7a-5886f696b-22z5b"]
Jul 28 21:21:37.742361 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.742337    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c655df5e-c50e-4945-a301-6a086b14dce4-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:37.742361 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.742363    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtdjv\" (UniqueName: \"kubernetes.io/projected/a9ce6bc0-a3af-4151-a91b-7bec9f6cf051-kube-api-access-gtdjv\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:37.742507 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.742377    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm9q7\" (UniqueName: \"kubernetes.io/projected/c655df5e-c50e-4945-a301-6a086b14dce4-kube-api-access-bm9q7\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:37.742507 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.742389    2555 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9ce6bc0-a3af-4151-a91b-7bec9f6cf051-plugins-config-volume\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\""
Jul 28 21:21:37.760199 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.760121    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"]
Jul 28 21:21:37.770210 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.770186    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-4e7a7a-548f57cd68-ch8s4"]
Jul 28 21:21:37.807418 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.807373    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"]
Jul 28 21:21:37.817058 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:37.817023    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-96b3c5-openshift-default-6b8b9db884-kvwkw"]
Jul 28 21:21:38.296098 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:38.296069    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bb9f589-5f45-4bc1-8756-6eb30253c3b3" path="/var/lib/kubelet/pods/6bb9f589-5f45-4bc1-8756-6eb30253c3b3/volumes"
Jul 28 21:21:38.296486 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:38.296432    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9ce6bc0-a3af-4151-a91b-7bec9f6cf051" path="/var/lib/kubelet/pods/a9ce6bc0-a3af-4151-a91b-7bec9f6cf051/volumes"
Jul 28 21:21:38.296741 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:38.296728    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c655df5e-c50e-4945-a301-6a086b14dce4" path="/var/lib/kubelet/pods/c655df5e-c50e-4945-a301-6a086b14dce4/volumes"
Jul 28 21:21:40.642264 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:40.642227    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dkqmg"]
Jul 28 21:21:52.950617 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:52.950589    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56794f8cc8-p7tjj_ac6ba921-e99d-4f78-a8a7-5b822dcc62e0/copy-manifests/0.log"
Jul 28 21:21:52.970202 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:52.970170    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56794f8cc8-p7tjj_ac6ba921-e99d-4f78-a8a7-5b822dcc62e0/manager/0.log"
Jul 28 21:21:56.140262 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:56.140227    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dkqmg_94ff04e3-52ac-412e-b428-e80e8d4882a4/limitador/0.log"
Jul 28 21:21:56.643314 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:56.643282    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj_a8284031-62bd-4acd-807d-34b0fcd0e9b5/istio-proxy/0.log"
Jul 28 21:21:57.145133 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:57.145097    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qldzp_9dc84e0f-6419-4542-bd1d-e6bf84316cb5/istio-proxy/1.log"
Jul 28 21:21:57.266602 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:57.266569    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ddg9m_c44c1507-f888-4d1c-8437-6c796bf17ee9/payload-pre-processing/0.log"
Jul 28 21:21:57.402736 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:57.402644    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-ktvgp_0a4b796a-f666-4783-bfbf-3b83ecf959c7/payload-processing/0.log"
Jul 28 21:21:57.525093 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:57.525063    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f98b6fcdf-f69c6_326f8187-7441-426a-b081-130b3e2a0bdb/router/0.log"
Jul 28 21:21:58.147993 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:58.147960    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-44mqh_56e31a77-af91-49b3-b321-247e0d34e732/main/0.log"
Jul 28 21:21:58.394187 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:58.394159    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-cts7s_654d37df-aa22-471e-9e1d-1e930faa221b/main/0.log"
Jul 28 21:21:59.529647 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:21:59.529613    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-5bbk5_3c9419d7-b694-4c86-b4e6-1eede7fdc3a8/main/0.log"
Jul 28 21:22:08.298621 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:08.298590    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vm6v9_4a04cb7b-6d7a-4c0b-a854-d12e6195bd34/global-pull-secret-syncer/0.log"
Jul 28 21:22:08.403145 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:08.403104    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6s9n2_41b6e0d1-3694-49b1-b3b3-ce9ee043fb71/konnectivity-agent/0.log"
Jul 28 21:22:08.506737 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:08.506709    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-26.ec2.internal_130d71e16700185813be32f181bd7fb9/haproxy/0.log"
Jul 28 21:22:13.747723 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:13.747691    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dkqmg_94ff04e3-52ac-412e-b428-e80e8d4882a4/limitador/0.log"
Jul 28 21:22:15.736841 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:15.736765    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-frl28_064d3b74-ea01-49c6-a3ec-b197a550242b/cluster-monitoring-operator/0.log"
Jul 28 21:22:16.110728 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:16.110681    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v9c6w_fe23709d-7f8b-4b19-af12-99289a729b5d/node-exporter/0.log"
Jul 28 21:22:16.136520 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:16.136489    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v9c6w_fe23709d-7f8b-4b19-af12-99289a729b5d/kube-rbac-proxy/0.log"
Jul 28 21:22:16.168763 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:16.168740    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v9c6w_fe23709d-7f8b-4b19-af12-99289a729b5d/init-textfile/0.log"
Jul 28 21:22:17.981560 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.981525    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"]
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.981893    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c000d44a-5737-41cd-9114-ad6088ac8b6f" containerName="payload-pre-processing"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.981904    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c000d44a-5737-41cd-9114-ad6088ac8b6f" containerName="payload-pre-processing"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.981913    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0781850-ac90-4ad5-8c62-0be429f9d9de" containerName="payload-processing"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.981919    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0781850-ac90-4ad5-8c62-0be429f9d9de" containerName="payload-processing"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.981926    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d7a8eb9-5557-4c62-95e2-e29403443f40" containerName="main"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.981946    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7a8eb9-5557-4c62-95e2-e29403443f40" containerName="main"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.981959    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb9f589-5f45-4bc1-8756-6eb30253c3b3" containerName="istio-proxy"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.981964    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb9f589-5f45-4bc1-8756-6eb30253c3b3" containerName="istio-proxy"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.981977    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbaa8510-65dc-4822-9d78-067ffb13c6ee" containerName="payload-pre-processing"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.981983    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbaa8510-65dc-4822-9d78-067ffb13c6ee" containerName="payload-pre-processing"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.981996    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9ce6bc0-a3af-4151-a91b-7bec9f6cf051" containerName="payload-processing"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982001    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9ce6bc0-a3af-4151-a91b-7bec9f6cf051" containerName="payload-processing"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982009    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c655df5e-c50e-4945-a301-6a086b14dce4" containerName="payload-pre-processing"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982014    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c655df5e-c50e-4945-a301-6a086b14dce4" containerName="payload-pre-processing"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982021    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53fc55c4-d712-4be8-a402-164e8dc346d1" containerName="payload-pre-processing"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982027    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="53fc55c4-d712-4be8-a402-164e8dc346d1" containerName="payload-pre-processing"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982032    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5b76d2d-eac8-4bf0-87f9-c202072c6dcc" containerName="payload-pre-processing"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982037    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5b76d2d-eac8-4bf0-87f9-c202072c6dcc" containerName="payload-pre-processing"
Jul 28 21:22:17.982084 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982091    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0781850-ac90-4ad5-8c62-0be429f9d9de" containerName="payload-processing"
Jul 28 21:22:17.982729 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982099    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5b76d2d-eac8-4bf0-87f9-c202072c6dcc" containerName="payload-pre-processing"
Jul 28 21:22:17.982729 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982108    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d7a8eb9-5557-4c62-95e2-e29403443f40" containerName="main"
Jul 28 21:22:17.982729 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982114    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bb9f589-5f45-4bc1-8756-6eb30253c3b3" containerName="istio-proxy"
Jul 28 21:22:17.982729 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982119    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9ce6bc0-a3af-4151-a91b-7bec9f6cf051" containerName="payload-processing"
Jul 28 21:22:17.982729 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982125    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbaa8510-65dc-4822-9d78-067ffb13c6ee" containerName="payload-pre-processing"
Jul 28 21:22:17.982729 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982130    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c000d44a-5737-41cd-9114-ad6088ac8b6f" containerName="payload-pre-processing"
Jul 28 21:22:17.982729 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982136    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c655df5e-c50e-4945-a301-6a086b14dce4" containerName="payload-pre-processing"
Jul 28 21:22:17.982729 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982142    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="53fc55c4-d712-4be8-a402-164e8dc346d1" containerName="payload-pre-processing"
Jul 28 21:22:17.982729 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.982148    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bb9f589-5f45-4bc1-8756-6eb30253c3b3" containerName="istio-proxy"
Jul 28 21:22:17.985246 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.985224    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:17.987878 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.987853    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hqh9t\"/\"openshift-service-ca.crt\""
Jul 28 21:22:17.988674 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.988651    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hqh9t\"/\"default-dockercfg-7vqqt\""
Jul 28 21:22:17.988814 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.988691    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hqh9t\"/\"kube-root-ca.crt\""
Jul 28 21:22:17.997209 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:17.997187    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"]
Jul 28 21:22:18.010249 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.010227    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-gzb4t_fc9d3dee-24c2-43a6-ae84-6af8aae2cf8a/networking-console-plugin/0.log"
Jul 28 21:22:18.123292 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.123254    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2ecc8039-5d02-40e9-8b76-b46ba60cc17a-proc\") pod \"perf-node-gather-daemonset-ccxm7\" (UID: \"2ecc8039-5d02-40e9-8b76-b46ba60cc17a\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.123292 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.123295    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2ecc8039-5d02-40e9-8b76-b46ba60cc17a-podres\") pod \"perf-node-gather-daemonset-ccxm7\" (UID: \"2ecc8039-5d02-40e9-8b76-b46ba60cc17a\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.123518 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.123382    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ecc8039-5d02-40e9-8b76-b46ba60cc17a-lib-modules\") pod \"perf-node-gather-daemonset-ccxm7\" (UID: \"2ecc8039-5d02-40e9-8b76-b46ba60cc17a\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.123518 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.123485    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ecc8039-5d02-40e9-8b76-b46ba60cc17a-sys\") pod \"perf-node-gather-daemonset-ccxm7\" (UID: \"2ecc8039-5d02-40e9-8b76-b46ba60cc17a\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.123518 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.123510    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvbml\" (UniqueName: \"kubernetes.io/projected/2ecc8039-5d02-40e9-8b76-b46ba60cc17a-kube-api-access-qvbml\") pod \"perf-node-gather-daemonset-ccxm7\" (UID: \"2ecc8039-5d02-40e9-8b76-b46ba60cc17a\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.224853 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.224796    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvbml\" (UniqueName: \"kubernetes.io/projected/2ecc8039-5d02-40e9-8b76-b46ba60cc17a-kube-api-access-qvbml\") pod \"perf-node-gather-daemonset-ccxm7\" (UID: \"2ecc8039-5d02-40e9-8b76-b46ba60cc17a\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.225093 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.224889    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2ecc8039-5d02-40e9-8b76-b46ba60cc17a-proc\") pod \"perf-node-gather-daemonset-ccxm7\" (UID: \"2ecc8039-5d02-40e9-8b76-b46ba60cc17a\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.225093 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.224917    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2ecc8039-5d02-40e9-8b76-b46ba60cc17a-podres\") pod \"perf-node-gather-daemonset-ccxm7\" (UID: \"2ecc8039-5d02-40e9-8b76-b46ba60cc17a\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.225093 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.224987    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ecc8039-5d02-40e9-8b76-b46ba60cc17a-lib-modules\") pod \"perf-node-gather-daemonset-ccxm7\" (UID: \"2ecc8039-5d02-40e9-8b76-b46ba60cc17a\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.225093 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.225024    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2ecc8039-5d02-40e9-8b76-b46ba60cc17a-proc\") pod \"perf-node-gather-daemonset-ccxm7\" (UID: \"2ecc8039-5d02-40e9-8b76-b46ba60cc17a\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.225278 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.225098    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ecc8039-5d02-40e9-8b76-b46ba60cc17a-sys\") pod \"perf-node-gather-daemonset-ccxm7\" (UID: \"2ecc8039-5d02-40e9-8b76-b46ba60cc17a\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.225278 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.225131    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2ecc8039-5d02-40e9-8b76-b46ba60cc17a-podres\") pod \"perf-node-gather-daemonset-ccxm7\" (UID: \"2ecc8039-5d02-40e9-8b76-b46ba60cc17a\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.225278 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.225150    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ecc8039-5d02-40e9-8b76-b46ba60cc17a-lib-modules\") pod \"perf-node-gather-daemonset-ccxm7\" (UID: \"2ecc8039-5d02-40e9-8b76-b46ba60cc17a\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.225278 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.225185    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ecc8039-5d02-40e9-8b76-b46ba60cc17a-sys\") pod \"perf-node-gather-daemonset-ccxm7\" (UID: \"2ecc8039-5d02-40e9-8b76-b46ba60cc17a\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.233347 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.233291    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvbml\" (UniqueName: \"kubernetes.io/projected/2ecc8039-5d02-40e9-8b76-b46ba60cc17a-kube-api-access-qvbml\") pod \"perf-node-gather-daemonset-ccxm7\" (UID: \"2ecc8039-5d02-40e9-8b76-b46ba60cc17a\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.295469 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.295434    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.436414 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.436389    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"]
Jul 28 21:22:18.438794 ip-10-0-137-26 kubenswrapper[2555]: W0728 21:22:18.438756    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2ecc8039_5d02_40e9_8b76_b46ba60cc17a.slice/crio-d2dd54c521ac0a78970f5db896d76c2f2833c089b070cdd0b309e16bd5fbda7a WatchSource:0}: Error finding container d2dd54c521ac0a78970f5db896d76c2f2833c089b070cdd0b309e16bd5fbda7a: Status 404 returned error can't find the container with id d2dd54c521ac0a78970f5db896d76c2f2833c089b070cdd0b309e16bd5fbda7a
Jul 28 21:22:18.731158 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.731090    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/1.log"
Jul 28 21:22:18.736745 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.736718    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ndvkk_d430e74f-09bd-48c4-903c-dba977c7db03/console-operator/2.log"
Jul 28 21:22:18.888131 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.888101    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7" event={"ID":"2ecc8039-5d02-40e9-8b76-b46ba60cc17a","Type":"ContainerStarted","Data":"a5919c66abd719a11eb689d86d5d5b333a61497e3bc33e836e56c6030122367f"}
Jul 28 21:22:18.888320 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.888154    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7" event={"ID":"2ecc8039-5d02-40e9-8b76-b46ba60cc17a","Type":"ContainerStarted","Data":"d2dd54c521ac0a78970f5db896d76c2f2833c089b070cdd0b309e16bd5fbda7a"}
Jul 28 21:22:18.888320 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.888182    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:18.905168 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:18.905110    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7" podStartSLOduration=1.9050923339999999 podStartE2EDuration="1.905092334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 21:22:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:22:18.904764793 +0000 UTC m=+3453.150141495" watchObservedRunningTime="2026-07-28 21:22:18.905092334 +0000 UTC m=+3453.150469039"
Jul 28 21:22:19.389991 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:19.389961    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-fnswx_fa4518af-977d-4c93-94a3-711eb64f3dc1/download-server/0.log"
Jul 28 21:22:20.054863 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:20.054830    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-nhxhl_a5eaf18c-6121-41c0-8ab2-e98bb06b258f/volume-data-source-validator/0.log"
Jul 28 21:22:21.486741 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:21.486713    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-whjpl_a2663cb4-05c5-4954-8517-3c12845ada7a/dns/0.log"
Jul 28 21:22:21.519870 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:21.519843    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-whjpl_a2663cb4-05c5-4954-8517-3c12845ada7a/kube-rbac-proxy/0.log"
Jul 28 21:22:21.604977 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:21.604924    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jqxrq_476fb5e0-9429-4e20-b3ab-4ed2f7701c88/dns-node-resolver/0.log"
Jul 28 21:22:22.332643 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:22.332612    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b2hkw_a1cc91af-e639-496c-a81f-84152a29f05c/node-ca/0.log"
Jul 28 21:22:23.493287 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:23.493260    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj_a8284031-62bd-4acd-807d-34b0fcd0e9b5/istio-proxy/0.log"
Jul 28 21:22:23.817856 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:23.817824    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qldzp_9dc84e0f-6419-4542-bd1d-e6bf84316cb5/istio-proxy/0.log"
Jul 28 21:22:23.842304 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:23.842279    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qldzp_9dc84e0f-6419-4542-bd1d-e6bf84316cb5/istio-proxy/1.log"
Jul 28 21:22:23.892045 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:23.892013    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ddg9m_c44c1507-f888-4d1c-8437-6c796bf17ee9/payload-pre-processing/0.log"
Jul 28 21:22:23.942208 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:23.942178    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-ktvgp_0a4b796a-f666-4783-bfbf-3b83ecf959c7/payload-processing/0.log"
Jul 28 21:22:23.988791 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:23.988762    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f98b6fcdf-f69c6_326f8187-7441-426a-b081-130b3e2a0bdb/router/0.log"
Jul 28 21:22:24.902981 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:24.902925    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-ccxm7"
Jul 28 21:22:25.019942 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:25.019893    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d8pjr_2224b59c-8ed4-4bca-8286-9ae7d7227d4b/serve-healthcheck-canary/0.log"
Jul 28 21:22:25.685257 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:25.685224    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-zj7nr_f8c3a22f-34cb-4baa-b9d8-d568862990f2/insights-operator/0.log"
Jul 28 21:22:25.686002 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:25.685986    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-zj7nr_f8c3a22f-34cb-4baa-b9d8-d568862990f2/insights-operator/1.log"
Jul 28 21:22:25.725735 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:25.725709    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d56fs_16ccfe8d-c942-44d4-84dd-e7d584e2078e/kube-rbac-proxy/0.log"
Jul 28 21:22:25.764026 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:25.764002    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d56fs_16ccfe8d-c942-44d4-84dd-e7d584e2078e/exporter/0.log"
Jul 28 21:22:25.804178 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:25.804149    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d56fs_16ccfe8d-c942-44d4-84dd-e7d584e2078e/extractor/0.log"
Jul 28 21:22:29.061638 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:29.061606    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj_a8284031-62bd-4acd-807d-34b0fcd0e9b5/istio-proxy/0.log"
Jul 28 21:22:29.290077 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:29.290044    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qldzp_9dc84e0f-6419-4542-bd1d-e6bf84316cb5/istio-proxy/0.log"
Jul 28 21:22:29.317605 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:29.317529    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qldzp_9dc84e0f-6419-4542-bd1d-e6bf84316cb5/istio-proxy/1.log"
Jul 28 21:22:29.340861 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:29.340834    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ddg9m_c44c1507-f888-4d1c-8437-6c796bf17ee9/payload-pre-processing/0.log"
Jul 28 21:22:29.361331 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:29.361306    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-ktvgp_0a4b796a-f666-4783-bfbf-3b83ecf959c7/payload-processing/0.log"
Jul 28 21:22:29.379811 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:29.379782    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f98b6fcdf-f69c6_326f8187-7441-426a-b081-130b3e2a0bdb/router/0.log"
Jul 28 21:22:29.601788 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:29.601763    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56794f8cc8-p7tjj_ac6ba921-e99d-4f78-a8a7-5b822dcc62e0/manager/0.log"
Jul 28 21:22:29.622583 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:29.622543    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56794f8cc8-p7tjj_ac6ba921-e99d-4f78-a8a7-5b822dcc62e0/copy-manifests/0.log"
Jul 28 21:22:30.798241 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:30.798210    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lzdlj_a8284031-62bd-4acd-807d-34b0fcd0e9b5/istio-proxy/0.log"
Jul 28 21:22:30.977166 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:30.977133    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54dcc5fbb6-mcjdm_526e728b-20ab-4852-99ba-0ddb7b2990ae/manager/0.log"
Jul 28 21:22:31.004827 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:31.004794    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qldzp_9dc84e0f-6419-4542-bd1d-e6bf84316cb5/istio-proxy/0.log"
Jul 28 21:22:31.033524 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:31.033494    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-qldzp_9dc84e0f-6419-4542-bd1d-e6bf84316cb5/istio-proxy/1.log"
Jul 28 21:22:31.054151 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:31.054064    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ddg9m_c44c1507-f888-4d1c-8437-6c796bf17ee9/payload-pre-processing/0.log"
Jul 28 21:22:31.075349 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:31.075322    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-ktvgp_0a4b796a-f666-4783-bfbf-3b83ecf959c7/payload-processing/0.log"
Jul 28 21:22:31.094659 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:31.094631    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f98b6fcdf-f69c6_326f8187-7441-426a-b081-130b3e2a0bdb/router/0.log"
Jul 28 21:22:35.997160 ip-10-0-137-26 kubenswrapper[2555]: I0728 21:22:35.997132    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-svj26_c674ba7d-16bd-4370-a3e2-b7931c3549e8/migrator/0.log"